🌱 InferSpore 🧩

A fully independent Large Language Model (LLM) inference engine, built leveraging cuBLAS and cub.

Name		Name	Last commit message	Last commit date
Latest commit History 71 Commits
src		src
tests		tests
tools		tools
.gitignore		.gitignore
CMakeLists.txt		CMakeLists.txt
LICENSE		LICENSE
README.md		README.md

Navigation Menu