Parameters to use?

#2
by hmfoo - opened

Love the speed! Any recommended parameters to use?

AIDC-AI org

Hi,

Thanks for your interest in our models. We use t=1, top_p=1, top_k=-1 for both Nano and Mini models.

Best regards,
Fan

Sign up or log in to comment