Synapse Open Synapse
AI

[Paper] RidgeFill: Training-Free Late-Layer Cache Fill for Faster Prefill

Reddit · r/LocalLLaMA ·

We introduce RidgeFill, a training-free way to shorten prefill by not computing most of a model's upper layers for the prompt.

Latest from Reddit · r/LocalLLaMA