Teledyne 2002 Marine Instruments User Manual


 
149-072011 Model 2002 Vacuum Gauge Page 15 of 38
If the analog output voltage is being used in a data acquisition system, the following formulas can be used to
calculate pressure.
Therefore,
Note that the INT function simply returns to the first digit in a number.
Examples:
INT (2.56) = 2
INT (9.87) = 9
---------------------------------------------------------------------------------------------------------------------
Voltage to pressure conversion example:
Given
V = 2.35 Volt
First calculate the exponent;
EXP = INT (2*2.35) - 6
= INT (4.7 - 6
= INT 4-6
= - 2
Next calculate the mantissa;
MANT = 1 + 18 * V - 9 (EXP +6)
= 1 + 18 * (2.35) - 9 * (2+6)
= 1 + 42.3 - 36
= 7.3
Finally the pressure is given by;
Pressure (torr) = MANT x 10EXP
= 7.3 x 10-2 Torr
EXP=INT (2*V)-
6
MANT=1+18*V-9*(EXP+6)
Pressure (Torr)=Mant x 10
exp