Developer Guide and Reference

ID 767251
Date 10/31/2024
Public
Document Table of Contents

PRECISION

Inquiry Intrinsic Function (Generic): Returns the decimal precision in the model representing real numbers with the same kind parameter as the argument.

result = PRECISION (x)

x

(Input) Must be of type real or complex; it can be scalar or array valued.

Results

The result is a scalar of type default integer. The result has the value INT((DIGITS( x) - 1) * LOG10(RADIX( x))). If RADIX( x) is an integral power of 10, 1 is added to the result.

Example

If X is a REAL(4) value, PRECISION(X) has the value 6. The value 6 is derived from INT ((24-1) * LOG10 (2.)) = INT (6.92...). For more information on the model for REAL(4), see Model for Real Data.