Stats

  • Locked Locked
  • Replies 8
  • Subscribers 143
  • Views 16084
  • Members are here 0
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

What setting will impact atof() output

wenckey

I run atof("9.12") in my CIW, it will return 9.11999999999999

And I run virtuoso -nocdsinit, it will return 9.12

What will impact that?

Parents
  • skillUser

    Hi,

    This setting controls the display precision:

    sstatus(fullPrecision t)

    you can test the setting using status(fullPrecision).  The documentation states this:

     If t, unformatted print functions (print, println, printlev) print floating point numbers in full precision (usually 16 digits); otherwise, the default is about 7 digits of precision.

    Best regards,

    Lawrence.

  • wenckey
    in reply to skillUser

    Thanks a lot Lawrence!!

    What if I want it to return "9.12"?

  • skillUser
    in reply to wenckey

    sstatus(fullPrecision nil)
    atof("9.12")
    => 9.12

    You didn't state what fullPrecision is currently set to, but I expect that it was set to 't', so setting it to 'nil' should give you the above result.

    Regards,

    Lawrence.

  • wenckey
    in reply to skillUser

    Works well.

    Thanks a lot!~

Reply
  • wenckey
    in reply to skillUser

    Works well.

    Thanks a lot!~

Children
No Data

Community Guidelines

The Cadence Design Communities support Cadence users and technologists interacting to exchange ideas, news, technical information, and best practices to solve problems and get the most from Cadence technology. The community is open to everyone, and to provide the most value, we require participants to follow our Community Guidelines that facilitate a quality exchange of ideas and information. By accessing, contributing, using or downloading any materials from the site, you agree to be bound by the full Community Guidelines.