Searched refs:mantissaSize (Results 1 – 1 of 1) sorted by relevance
55 split_coefficient(double &coefficient, int32 mantissaSize, in split_coefficient() argument67 int32 maxValue = 1 << mantissaSize; in split_coefficient()68 res = 12 - mantissaSize; in split_coefficient()113 int32 mantissaSize = horizontal ? 7 : 6; in update_coefficients() local149 split_coefficient(coefficients[i][j], mantissaSize in update_coefficients()175 split_coefficient(coefficients[i][tap2Fix], mantissaSize in update_coefficients()