I do not see any indication when I have a voice mail message.
Try this: Open Settings > Call settings > Voice call > Voicemail > Service > Make sure My carrier is ticked.