my stupid bug
May. 6th, 2020 10:40 am![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
izardI was recently working on a problem, where one of the performance metrics I measured was ~100x higher than expected. It is almost impossible to make a 100x optimization, unless something is severely broken...
In the end, it appeared to be my error. But it was not a measurement error, I triple checked my measurement code and it was correct.
The buggy part was printing the end result. I made a typo in printf format, "%ull" instead of "%llu", so it printed "ll" in the end. Then I mistook "ll" for "11" when reading, and this multiplied the result 100x. I was slightly curious why random performance readings always end with 11, but I still did not catch it. Only after I pasted the result to Excel to plot a graph I realized what went wrong.
This made it in my list of top 5 stupid programming errors I ever made :)
In the end, it appeared to be my error. But it was not a measurement error, I triple checked my measurement code and it was correct.
The buggy part was printing the end result. I made a typo in printf format, "%ull" instead of "%llu", so it printed "ll" in the end. Then I mistook "ll" for "11" when reading, and this multiplied the result 100x. I was slightly curious why random performance readings always end with 11, but I still did not catch it. Only after I pasted the result to Excel to plot a graph I realized what went wrong.
This made it in my list of top 5 stupid programming errors I ever made :)
no subject
Date: 2020-05-06 03:45 pm (UTC)