Huawei Develops HiFloat4 for Efficient AI Training

Huawei’s research team has introduced HiFloat4, a 4-bit precision format for AI training that outperforms the Western-developed MXFP4 format in tests conducted on Huawei Ascend chips. The evaluation showcased HiFloat4's superior performance across various model types, including OpenPangu-1B and Llama3-8B, indicating lower relative loss compared to other formats. This development reflects a growing trend among Chinese tech companies to innovate their AI infrastructure amid increasing export controls affecting access to advanced computing technologies.