Benchmarks — 7M params (preview)
Synthetic baseline on a 7M model. Values are illustrative and subject to change.
Accuracy suite (percent)
Throughput vs. context
Average decode TPS: 30.29
Synthetic baseline on a 7M model. Values are illustrative and subject to change.