Western diet is actually notoriously low on fiber and high in sugar, and the citrus pith is also high in vitamin C.

So for many people eating the pith would actually be a healthier choice - in the context of their low fiber/high sugar diet.