Can you add SupraElegans-500k please?
#75
by AxionLab-official - opened
Hi Axion, both gpus are currently busy so will add it in a bit!
Okay! Take your time
Here are updated benchmarks after another run, now with arithmark3:
hellaswag: 24.278%
arc_e: 21%
arc_c: 22%
piqa: 49.728%
winogrande: 52%
arithmark_3.0: 22.000%
shes up!
Datdanboi25 changed discussion status to closed
thx!