48GB VRAM version?
#7
by
gileneo
- opened
would be great to run this with two kidneys 😜
Thank you for your interest! The 48GB VRAM version is not in our main update plan for the immediate future.
However, after quantization, our model will likely be runnable with 48GB VRAM. Please stay tuned for community updates.
@hyb1124
how much VRAM will be needed for offline generation?
will rtx 5090 will be suitable for offline generation?