Show in context Developer, Moderator, Test Pilot

First ensure there's no filter hiding any of the contacts then simply navigate through to each folder manually and that will recalculate the totals. If the total count next to the folder is in gray then you have a filter active which will pause the total count update.

I hope this helps and please let us know if we can be of further assistance.