AirLLM 70B inference with single 4GB GPU

Article URL: https://github.com/lyogavin/airllm

Comments URL: https://news.ycombinator.com/item?id=49154228

Points: 134

# Comments: 46