Product Documentation
Virtuoso Technology Data SKILL Reference
Product Version IC23.1, June 2023

techSetPrecision

techSetPrecision(
x_digits
) 
=> t / nil 

Description

Sets the precision, or number of digits following the decimal point, to be used in floating-point calculations.

This function treats a real number as a float (double) number and performs the following checks.

Arguments

x_digits

Number of digits following the decimal point in floating-point numbers.

Valid values: 1 through 8

If a value greater than 8 is assigned, x_digit is set to 8. It is also ensured that no overflow occurs when the value gets close to 8.

Value Returned

t

The specified precision was set.

nil

The precision was not set because the specified precision value was invalid.

Example

techSetPrecision(6)

Sets the precision for floating-point numbers to 6.


Return to top
 ⠀
X