Open source repo

ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine tune Optimizations

Visit resource

Why it is on 0CAP

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations