It can come off like you are disregarding their opinion entirely, or at least devaluing it and focusing on something seemingly small and inconsequential instead. The phrase is to clarify that’s not your intention. You don’t have to write a strangely vindictive rant, its not that deep dude.