Medusa

Three open-source headless commerce engines that make serverless e-commerce actually viable.

Speculative decoding makes LLMs 2-3x faster with zero quality loss by using a small draft model to guess tokens that a large model verifies in para...