A water softener system is the most effective type of whole house water filter to remove calcium and magnesium, the minerals that cause water to be “hard.” While hard water and the minerals that cause hardness are not unhealthy, they do cause problems for people who bathe in it, plumbing, and appliances.