Parameters to use?
#2
by hmfoo - opened
Love the speed! Any recommended parameters to use?
Hi,
Thanks for your interest in our models. We use t=1, top_p=1, top_k=-1 for both Nano and Mini models.
Best regards,
Fan
Love the speed! Any recommended parameters to use?
Hi,
Thanks for your interest in our models. We use t=1, top_p=1, top_k=-1 for both Nano and Mini models.
Best regards,
Fan