Bytedance argues most AI training phases are unnecessary and backs it up with a competitive open model
AI agents increasingly rely on complex training pipelines. A team from TikTok parent Bytedance and several US universities aims to show that three steps are enough.
AI models are expected to research the web on their own, run code, and solve multi-step tasks. According to a new paper, the training methods behind these capabilities are growing more and more nested, with many developers stacking numerous training phases one after another. The paper argues it's become almost impossible to tell which step actually helps, and reproducing the work is getting expensive.
Continue reading with THE DECODER+
Every Plus article and the full archive
Frontier Radar: 6 deep dives a year
Already a subscriber? Sign in Back to the homepage
"Ask AI" with your Decoder subscription
Ask a question about the article or an AI topic. You can ask follow-up questions.