Does ColossalAI support Huawei Ascend hardware platform for trainning? #6190
Unanswered
zane0506
asked this question in
Community | Q&A
Replies: 1 comment
|
Huawei Ascend support for ColossalAI training: Current status: What would be needed:
# Ascend uses CANN instead of CUDA
import torch_npu
torch.npu.is_available() # Check NPU
# HCCL instead of NCCL
torch.distributed.init_process_group(backend="hccl")Alternatives:
Resources:
We've explored multi-hardware training at RevolutionAI. What's your Ascend setup — 910A, 910B, or cloud? |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I want to train LLM on Huawei Ascend hardware platform with multi-machine multi-GPU,Does ColossalAI support it smoothly?
All reactions