Moonshot AI has unveiled Kimi K3, a massive 2.8 trillion-parameter model that currently stands as the largest open-weight artificial intelligence system available. The model utilizes a mixture-of-experts architecture with 896 experts, though it only activates 16 experts per token to maintain computational efficiency. It features a 1 million-token context window and native vision support, allowing it to process vast amounts of data and visual information in a single prompt. Source
Read the full article at the source.
Comments (0)
No comments yet. Be the first to comment!