Moonshot AI has unveiled Kimi K3, a massive 2.8 trillion-parameter model that currently stands as the largest open-weight artificial intelligence system available. The model utilizes a mixture-of-experts architecture with 896 experts, though it only activates 16 experts per token to maintain computational efficiency. It features a 1 million-token context window and native vision support, allowing it to process vast amounts of data and visual information in a single prompt. Source
Läs hela artikeln hos källan.
Kommentarer (0)
Inga kommentarer ännu. Bli först med att kommentera!