The company also demonstrates initial training of a one-trillion-parameter AI model on a single machine using conventional DDR5 memory chips.



Source: ADnet
Source Link: https://www.zdnet.com/article/how-cerebras-boosted-metas-llama-to-frontier-model-performance/