Post
2,948
One number missing from LFM3's on-device story: memory at 256K context. Liquid AI reports 1.90 GB peak on iPhone 17 Pro at 32K. From the pinned config, f16 K/V cache alone would be 0.41 GB at 32K, 1.61 GB at 128K and 3.22 GB at 256K, before weights and runtime buffers. The chart shows the calculation, not a phone measurement. If you have run longer contexts on-device, share peak memory and time to first token here: LiquidAI/LFM3-1.7B#5
Model: LiquidAI/LFM3-1.7B
Model: LiquidAI/LFM3-1.7B