[XviD-devel] big trellis bug

Edouard Gomez ed.gomez at free.fr
Sun Nov 23 11:33:10 CET 2003


Christoph Lampert (chl at math.uni-bonn.de) wrote:
> Lambda = 0xfe00/(q*q) = 65024/4 = 16256
> 727*727*Lambda = 8591767424 which has 33 bits!

Yes i noticed  that overflow yesterday, that's why  i asked for original
coefficients. DC  values are very  likely to overflow this  formula.

-- 
Edouard Gomez


More information about the XviD-devel mailing list