LightGPT-instruct-6B
LightGPT-instruct-6B is an AI model published by 亚马逊, released on 2023-05-24, for 基础大模型, with 60.0B parameters, and 2K tokens context length, requiring about 12.2GB storage, under the Apache 2.0 license.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
LightGPT是亚马逊发布的基于GPT-J-6B微调的指令优化的大语言模型。支持的语言为英文，完全开源。
相比较原始的GPT-J模型，LightGPT Instruct 6B的性能更好，其对比结果如下：
| LAMBADA PPL | LAMBADA Acc | Winogrande | Hellaswag | PIQA | |
|---|---|---|---|---|---|
| GPT-J | 3.99 | 69.7% | 65.3% | 66.1% | 76.5% |
| LightGPT-instruct | 4.33 | 65.0% | 64.6% | 63.9% | 75.5% |
欢迎关注 DataLearner 官方微信，获得最新 AI 技术推送
