Sum() based conditions not working on Canvas dashboard

When adding a Sum of filter condition to a visualisation like this:

This appears to sometimes automatically revert to a regular (not-summed) filter:

This happened when trying to add this to a column visualisation on a canvas dashboard.