Once you've listened to your voice messages, the voice message icon should disappear. If all voice messages have already been listened to and the icon is still there, try turning off your phone and turn it back on after a few seconds. The icon should be gone by then.