RuntimeError: Ascend kernel runtime initialization failed, device id: 0. The details refer to 'Ascend Error Message'.

[pavlovmc]

Hi.

I'm trying to run Qwen in openEuler 22.03. I'va installed Ascend-cann-toolkit and Ascend-cann-kenrels, but have a problem with mindspore. There is not version 2.4.0 in daily build in https://repo.mindspore.cn/mindspore/mindspore/version/

I tried to use mindspore version 2.5.0 and got the error:

Qwen2ForCausalLM has generative capabilities, as `prepare_inputs_for_generation` is explicitly overwritten. However, it doesn't directly inherit from `GenerationMixin`.`PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate` and other related functions.
  - If you are the owner of the model architecture code, please modify your model class such that it inherits from `GenerationMixin` (after `PreTrainedModel`, otherwise you'll get an exception).
  - If you are not the owner of the model architecture class, please contact the model code owner to update it.
Sliding Window Attention is enabled but not implemented for `eager`; unexpected results may be encountered.
Traceback (most recent call last):
  File "/home/HwHiAiUser/orange-pi-mindspore/Online/14-qwen1.5-0.5b/qwen1.5-0.5b.py", line 9, in <module>
    model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen1.5-0.5B-Chat", ms_dtype=mindspore.float16)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/auto/auto_factory.py", line 510, in from_pretrained
    return model_class.from_pretrained(
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/modeling_utils.py", line 2942, in from_pretrained
    model = cls(config, *model_args, **model_kwargs)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 666, in __init__
    self.model = Qwen2Model(config)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 472, in __init__
    [Qwen2DecoderLayer(config, layer_idx) for layer_idx in range(config.num_hidden_layers)]
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 472, in <listcomp>
    [Qwen2DecoderLayer(config, layer_idx) for layer_idx in range(config.num_hidden_layers)]
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 368, in __init__
    self.self_attn = QWEN2_ATTENTION_CLASSES[config._attn_implementation](config, layer_idx)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 273, in __init__
    self.rotary_emb = Qwen2RotaryEmbedding(
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/transformers/models/qwen2/modeling_qwen2.py", line 141, in __init__
    inv_freq = 1.0 / (self.base ** (ops.arange(0, self.dim, 2, dtype=mindspore.int64).float() / self.dim))
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindnlp/core/ops/creation.py", line 78, in arange
    return mindspore.mint.arange(start, end, step, dtype=dtype)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindspore/ops/function/array_func.py", line 351, in arange_ext
    return arange_(start, end, step, dtype)
  File "/home/HwHiAiUser/ai_project/lib64/python3.9/site-packages/mindspore/ops/auto_generate/gen_ops_prim.py", line 1866, in __call__
    return _convert_stub(pyboost_arange(self, [start, end, step, dtype if dtype is None else dtype_to_type_id('Arange', 'dtype', dtype)]))
RuntimeError: Ascend kernel runtime initialization failed, device id: 0. The details refer to 'Ascend Error Message'. 

----------------------------------------------------
- Framework Error Message: (For framework developers)
----------------------------------------------------
Call aclrtSetDevice failed, ret[507033]. Got device count[1] and device id[0], please check if device id is valid.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:372 Init
mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:660 SetRtDevice

Can you say how to fix that error?

[cui0523]

You can try operating on Ubuntu images.