RC RANDOM CHAOS

model compression

1 post

Parameter count is the wrong number to watch
Article

Parameter count is the wrong number to watch

PrismML's Ternary Bonsai 2 27B fits a 27B multimodal model into 5.9GB, and its footprint and energy numbers matter more than parameter count.