[Paper] RidgeFill: Training-Free Late-Layer Cache Fill for Faster Prefill
We introduce RidgeFill, a training-free way to shorten prefill by not computing most of a model's upper layers for the prompt.
We introduce RidgeFill, a training-free way to shorten prefill by not computing most of a model's upper layers for the prompt.