Quantisation?
#2
by dineshananthi - opened
Do we have a support to quantise this model?
Do we have a support to quantise this model?
The model is open weights, so you can follow any quantization approach you like. if you mean for any plans to released a quantized version, not at the moment.
Hope that helps