Skip to main content ↑ ↓

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: 32-bit ver and 64 bit ver have different rounding behaviors (Read 1748 times) previous topic - next topic
0 Members and 1 Guest are viewing this topic.

32-bit ver and 64 bit ver have different rounding behaviors

When converting 32-bit floating-point PCM to 24-bit fixed-point PCM, the 32-bit version rounds half to even and the 64-bit version rounds half away from zero.
When converting 32-bit floating-point PCM to 16-bit fixed-point PCM, both round half to even.
Why is there such a difference?

Re: 32-bit ver and 64 bit ver have different rounding behaviors

Reply #1 –
Thanks for the bug report.

The difference comes from different CPU optimizations used in different builds.

These differences in output are not an intended behavior and will be addressed in a future update, though I can't think of actual harm caused by this, only synthetic test signals can ever expose them?
Microsoft Windows: We can't script here, this is bat country.
 

Re: 32-bit ver and 64 bit ver have different rounding behaviors

Reply #2 –
Fixed in today's build.
Microsoft Windows: We can't script here, this is bat country.