allenai/Molmo2-ER
Image-Text-to-Text • 5B • Updated • 5.96k • 16
alkinun
AtAndDev
AI & ML interests
decentralize
Recent Activity
liked a model about 4 hours ago
allenai/Molmo2-ER liked a model about 4 hours ago
JetBrains/Mellum2-12B-A2.5B-Thinking liked a model about 4 hours ago
bench-labs/GCTokenizer-v1Organizations
liked 3
models about 4 hours ago
reacted to wop's post with 🔥 about 4 hours ago
Post
910
bench-labs/GCTokenizer-v1 , a multilingual tokenizer which does not require a training corpus
bench-labs developed **GCTokenizer-v1**, which is a multi-lingual tokenizer
Available in four sizes: 32K, 65K, 131K and 262K tokens "S, M, L, XL"
It utilizes an encoding scheme which allows it to handle characters in any language around the world
General (multi lingual)
Consensus (from multiple model tokenizers consensus)
Tokenizer
We included an implementation script too,
built like BPE- it can encode arbitrary text, most of the time, efficiently
Available in four sizes: 32K, 65K, 131K and 262K tokens "S, M, L, XL"
It utilizes an encoding scheme which allows it to handle characters in any language around the world
General (multi lingual)
Consensus (from multiple model tokenizers consensus)
Tokenizer
We included an implementation script too,
built like BPE- it can encode arbitrary text, most of the time, efficiently
liked 2
datasets 1 day ago
liked 2
models 1 day ago
liked a
dataset 2 days ago
upvoted a paper 2 days ago
liked a
dataset 2 days ago
liked a
model 3 days ago
liked a
Space 4 days ago
liked a
dataset 4 days ago
updated a
dataset 4 days ago
published a
dataset 4 days ago
liked a
model 4 days ago
replied to SoulInPsyAbstract's post 4 days ago
holy chatgpt
liked 2
models 4 days ago
