Safetensors
English
gpt2
SLiNeP / README.md
simonko912's picture
Update README.md
7fe4db6 verified
|
Raw
History Blame
522 Bytes
metadata
license: apache-2.0
datasets:
  - tomg-group-umd/wikipedia-en-2k-samples
  - BASF-AI/WikipediaEasy10Classification
language:
  - en

SLiNeP

Super Low Parameter Wikipedia-based Neural Predictor Super small gpt 2 based model trained from 11.6 Mb of wikipedia data.

Each topic starts with Topic Name : Topic Text and ends with <|endmsg|>. This is the medium version repo. Since the model is small and trained on minimal data it doesnt know many facts, but it learned some english. Its recommended to finetune it.