Pretraining From Scratch on an Inference-Only NPU: VKORE-46M-NPU
VIDRAFT successfully pretrained a 46M-parameter language model from scratch on an inference-only NPU, demonstrating that backpropagation and optimizer updates can be performed on hardware previously considered unsuitable for training.