By using our website, you agree to the collection and processing of your data collected by 3rd party. See GDPR policy
Compact mode

Mixture of Experts

Neural network with specialized expert modules

Known for Scaling Model Capacity

Core Classification

Industry Relevance

Historical Information

Technical Characteristics

Facts

  • Interesting Fact 🤓

    Fascinating trivia or lesser-known information about the algorithm
    • Only activates subset of parameters during inference

FAQ about Mixture of Experts

Contact: [email protected]