schonsense/Synesthesia
Text Generation
•
71B
•
Updated
Mark Fenlon PRO
schonsense
AI & ML interests
Testing ground repo for merging, finetuning, and LORA manipulations.
Recent Activity
updated
a model
about 19 hours ago
schonsense/Synesthesia
published
a model
about 20 hours ago
schonsense/Synesthesia
updated
a model
2 days ago
schonsense/IPOplectic_IMAT_GGUF
Organizations
updated
a
model
about 19 hours ago
published
a
model
about 20 hours ago
updated
3
models
2 days ago
published
a
model
2 days ago
updated
a
model
2 days ago
published
a
model
2 days ago
commented on
The Optimal Architecture for Small Language Models
2 days ago
Very interesting, thank you.
commented on
The Optimal Architecture for Small Language Models
3 days ago
Interesting. If you compare only the model layer parameters to their performances, are any different trends seen? Thank you for responding.
commented on
The Optimal Architecture for Small Language Models
3 days ago
Can you discuss the additional things contributing to param count that were not mentioned in your article? embedding/head size, intermediate dimensions? I'm struggling to see how a 768x4 has equivalent params to a 512x12.
published
a
model
3 days ago
updated
3
models
5 days ago
published
a
model
8 days ago
updated
3
models
8 days ago
System prompt and sampler settings
❤️
1
#1 opened 8 days ago
by
schonsense