IBM Support

HD59503: SKETCHER : DIMENSION CANNOT BE CORRECTLY ROUNDED UP WHEN ACCURA CY IS SET TO 8 DECIMAL

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as documentation error.

Error description

  • SKETCHER : DIMENSION CANNOT BE CORRECTLY
    ROUNDED UP WHEN ACCURACY IS SET TO 8
    DECIMAL
    .
    Scenario:
    0. Select Menu bar->Tools->Options->General-
    >Parameters and
    Measure->Units tab->Dimensions display->Display
    for the magnitude
    Length->Decimal places for read/write numbers
    and specify 3 and
    click OK.
    1. Select Menu bar->File->Open.
    2. Select Sketch.CATPart.
    3. Select Open.
    4. Select Sketch.1 and perform double click.
    5. Select 60 for dimension value and perform
    double click.
    6. Constraint Definition is displayed.
    7. Modify Value to 60.5554.
    8. Dimension value is displayed as 60.555.
    9. Select dimension value 60.555 and perform
    double click.
    10. Modify Value to 60.5555.
    11. Dimension value is displayed as 60.556.
    12. Dimension value is rounded up.
    Result A : Digit number after decimal point is 3,
    behavior of round-up and round-down follows half
    adjust rule.
    13. Select Menu bar->Tools->Options->General-
    >Parameters and Measure->Units tab->Dimensions
    display->Display for the magnitude Length-
    >Decimal places for read/write numbers and
    specify 8 and click OK.
    14. Follow from STEP1 to STEP6.
    15. Modify Value to 60.555555554.
    16. Dimension value is displayed as 60.55555555.
    17. Select dimension value 60.55555555 and
    perform double click.
    18. Modify Value to 60.555555555.
    19. Dimension value is displayed as 60.55555555.
    20. Dimension value is not rounded up. This result
    is different with result of case that Decimal places
    for read/write numbers is 3.
    Result B : Digit number after decimal point is 8,
    behavior of round-up and round-down does not
    follow half adjust rule.
    .
    Expected Result :
    Behavior of round-up and round-down should not
    depend on digit number after decimal point.It
    should be same for all allowable decimal digit.
    .
    .
    

Local fix

Problem summary

  • SKETCHER : DIMENSION CANNOT BE CORRECTLY ROUNDED UP WHEN ACCURA
    CY IS SET TO 8 DECIMAL
    SKETCHER : DIMENSION CANNOT BE CORRECTLY
    ROUNDED UP WHEN ACCURACY IS SET TO 8
    DECIMAL
    .
    Scenario:
    0. Select Menu bar->Tools->Options->General-
    >Parameters and
    Measure->Units tab->Dimensions display->Display
    for the magnitude
    Length->Decimal places for read/write numbers
    and specify 3 and
    click OK.
    1. Select Menu bar->File->Open.
    2. Select Sketch.CATPart.
    3. Select Open.
    4. Select Sketch.1 and perform double click.
    5. Select 60 for dimension value and perform
    double click.
    6. Constraint Definition is displayed.
    7. Modify Value to 60.5554.
    8. Dimension value is displayed as 60.555.
    9. Select dimension value 60.555 and perform
    double click.
    10. Modify Value to 60.5555.
    11. Dimension value is displayed as 60.556.
    12. Dimension value is rounded up.
    Result A : Digit number after decimal point is 3,
    behavior of round-up and round-down follows half
    adjust rule.
    13. Select Menu bar->Tools->Options->General-
    >Parameters and Measure->Units tab->Dimensions
    display->Display for the magnitude Length-
    >Decimal places for read/write numbers and
    specify 8 and click OK.
    14. Follow from STEP1 to STEP6.
    15. Modify Value to 60.555555554.
    16. Dimension value is displayed as 60.55555555.
    17. Select dimension value 60.55555555 and
    perform double click.
    18. Modify Value to 60.555555555.
    19. Dimension value is displayed as 60.55555555.
    20. Dimension value is not rounded up. This result
    is different with result of case that Decimal places
    for read/write numbers is 3.
    Result B : Digit number after decimal point is 8,
    behavior of round-up and round-down does not
    follow half adjust rule.
    .
    Expected Result :
    Behavior of round-up and round-down should not
    depend on digit number after decimal point.It
    should be same for all allowable decimal digit.
    .
    .
    

Problem conclusion

  • THIS MODIFICATION WILL BE INCLUDED IN CATIA
    DOCUMENTATION DELIVERED WITH CATIA
    VERSION 5 RELEASE 18
    .
    Existing algorithm is designed to manage round off
    value upto decimal places 8.Above this value round
    off result may be inconsistent. This behavior is
    updated in Documentation. Please refer following
    Doc reference
    Product Synthesis >>
    Knowledge Advisor>>
    Knowledge Advisor>>
    Units>>
    Magnitude Display>>
    If you specify a number of decimal places greater
    than 8 the computed value will not be rounded-up.
    .
    .
    

Temporary fix

Comments

APAR Information

  • APAR number

    HD59503

  • Reported component name

    CATIA V5 NT>XP

  • Reported component ID

    569151000

  • Reported release

    517

  • Status

    CLOSED DOC

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt

  • Submitted date

    2006-11-23

  • Closed date

    2007-02-02

  • Last modified date

    2007-02-02

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

[{"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Product":{"code":"SSVJ2K","label":"CATIA V5"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"517","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
02 February 2007