DataLearner logo
TI

TinyLlama

Foundation model

TinyLlama

Release date: 2023-09-04Updated: 2024-01-06Views: 868
Parameters
1.1B
Context length
2K
Multilingual
No data
Reasoning ability
No data

TinyLlama is an AI model published by Singapore University of Technology and Design, released on 2023-09-04, for Foundation model, with 1.1B parameters, and 2K context length, requiring about 4.4GB storage, with a 25.02 score on C-Eval.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

TinyLlama

Model basics

Reasoning traces
No data
Thinking modes
Thinking modes not supported
Context length
2K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2023-09-04
Model file size
4.4GB
MoE architecture
No
Total params / Active params
1.1B / Not applicable
Knowledge cutoff
No data
TinyLlama

Open source & experience

Code license
Weights license
Apache 2.0- Commercial use permitted
Live demo
N/A
TinyLlama

Official resources

Paper
DataLearnerAI blog
N/A
TinyLlama

API details

API speed
No data
No public API pricing yet.
TinyLlama

Benchmark Results

TinyLlama currently shows benchmark results led by GSM8K (67 / 70, score 2.27), C-Eval (46 / 48, score 25.02), MBPP (68 / 70, score 19.91). This page also consolidates core specs, context limits, and API pricing so you can evaluate the model from benchmark results and deployment constraints together.

Thinking

General Knowledge

2 evaluations
Benchmark / mode
Score
Rank/total
C-Eval
Standard Mode
25.02
46 / 48
MMLU
Standard Mode
24.30
124 / 124

Math and Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
GSM8K
Standard Mode
2.27
67 / 70

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
MBPP
Standard Mode
19.91
68 / 70
HumanEval
Standard Mode
6.71
101 / 101
TinyLlama

Publisher

Singapore University of Technology and Design
Singapore University of Technology and Design
View publisher details
TinyLlama

Model Overview

TinyLlama is an AI model published by Singapore University of Technology and Design, released on 2023-09-04, for Foundation model, with 1.1B parameters, and 2K context length, requiring about 4.4GB storage, with a 25.02 score on C-Eval.

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.

DataLearner WeChat QR code