Switch Transformer
Foundation modelSwitch Transformer
Parameters
1.6T
Context length
2K
Chinese support
Not supported
Reasoning ability
Switch Transformer is an AI model published by Google Research, released on 2021-01-11, for Foundation model, with 1.6T parameters, and 2K context length.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
Switch Transformer
Model basics
Reasoning traces
Not supported
Thinking modes
Thinking modes not supported
Context length
2K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2021-01-11
Model file size
No data
MoE architecture
No
Total params / Active params
1.6T / N/A
Knowledge cutoff
No data
Switch Transformer
Open source & experience
Code license
No data
Weights license
No data
GitHub repo
GitHub link unavailable
Hugging Face
Hugging Face link unavailable
Live demo
No live demo
Switch Transformer
Official resources
DataLearnerAI blog
No blog post yet
Switch Transformer
API details
API speed
No data
No public API pricing yet.
Switch Transformer
Benchmark Results
No benchmark data to show.
Compare with other models
No curated comparisons for this model yet.
Want a custom combination? Open the compare tool
Switch Transformer
Publisher
Google Research
View publisher details Switch Transformer
Model Overview
Switch Transformer is an AI model published by Google Research, released on 2021-01-11, for Foundation model, with 1.6T parameters, and 2K context length.
DataLearner on WeChat
Follow DataLearner on WeChat for AI model updates and research notes.
