AirLLM 70B inference with single 4GB GPU
This repo is tracked on the whatstrending.ai trending index. Repo owners are welcome to add the badge.
[](https://whatstrending.ai/repos/lyogavin/airllm)