Sum() based conditions not working on Canvas dashboard

When adding a Sum of filter condition to a visualisation like this:
image

This appears to sometimes automatically revert to a regular (not-summed) filter:
image

This happened when trying to add this to a column visualisation on a canvas dashboard.