How much GPU memory is required for BF16?
How much GPU memory is required for BF16?
I'm running about 29.6 gb with a 5 second, .4megapixel gen, which is eating up about 100 gb of shared gpu memory (ram).
what is the minimun vram + ram config
I will be testing all the models soon on my rtx pro 6000.
Will see how much each of them takes
I'm able to run the 55gb text encoder and the 66.3gb model file together on my 128gb system ram and 24gb 4090.
I'm able to run the 55gb text encoder and the 66.3gb model file together on my 128gb system ram and 24gb 4090.
I am curious about generation speeds, I downloading the prunned Convrot files hoping to get good speeds. also what res are you pushing?
Well, speed is not the goal when juggling these beasts. lol. It is waaaaaaaaaaaaaay faster running the quantized versions. 4s 720p vid: 1st run was 15:01 then subsequent were 416-422s. The load times are brutal.
Well, speed is not the goal when juggling these beasts. lol. It is waaaaaaaaaaaaaay faster running the quantized versions. 4s 720p vid: 1st run was 15:01 then subsequent were 416-422s. The load times are brutal.
did you anyone checked the quality difference between the bf16, int8 and int8_pruned? any speed and quality comparison?
The quality is very close between the 3 versions. In fact, you can run the small one to see what kind of output you will get, and if you love the video, then re-run it with the same random number seed, with the high quality version of the model. You can think of it as a way to get a master copy, with the quantized versions offering very close almost identical previews. I posted a side by side comparison on my X acct, but I don't think I can post that link here.
我5090+256g内存，测试了各种版本，发现都一样，都能跑，只是用的内存变大了。我测试后发现生成时间之类的变化很小。我感觉他这个模型本身权重好像对显存不敏感，但是分辨率和时长好像没费显存
Mine runs well on 196gb ram and NVIDIA GeForce RTX 5090 32 gb vram. Able to make 30 second videos with loosing quality. Im pushing 45 seconds now. This one is far better than ltx so far
mine at 128gb RAM and rtx 4090 any 12second 1x1 and 16x9 HD videos are averaging between 10 to 13mins. Have sageattention and the workflow is the DasiwaMinimaxH3WorkflowsT2VA_cMMH3V11 from civitai. I still dont believe this is running locally 😂