SW
Switch Transformer
Foundation modelSwitch Transformer
Release date: 2021-01-11Updated: 2023-03-13Views: 655
Parameters
1.6T
Context length
2K
Multilingual
No data
Reasoning ability
No data
Switch Transformer is an AI model published by Google Research, released on 2021-01-11, for Foundation model, with 1.6T parameters, and 2K context length.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
Switch Transformer
Model basics
Reasoning traces
No data
Thinking modes
Thinking modes not supported
Context length
2K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2021-01-11
Model file size
No data
MoE architecture
No
Total params / Active params
1.6T / Not applicable
Knowledge cutoff
No data
Switch Transformer
Open source & experience
Code license
No data
Weights license
No data
GitHub repo
N/A
Hugging Face
N/A
Live demo
N/A
Switch Transformer
Official resources
Paper
DataLearnerAI blog
N/A
Switch Transformer
API details
API speed
No data
No public API pricing yet.
Switch Transformer
Publisher
Google Research
View publisher details Switch Transformer
Model Overview
Switch Transformer is an AI model published by Google Research, released on 2021-01-11, for Foundation model, with 1.6T parameters, and 2K context length.
DataLearner on WeChat
Follow DataLearner on WeChat for AI model updates and research notes.
