ByteDance unveils UltraMem, cutting AI inference costs by 83%
[Photo/VCG] Chinese tech heavyweight ByteDance announced on Thursday the launch of its new model architecture, UltraMem, which reduces the inference costs of artificial intelligence-powered models by up to 83 percent. According to the company’s Doubao LLM team, UltraMem enhances the inference speed by 2 to 6 times compared to traditional MoE (mixture-of-experts) architectures. This technological…