Well, I actually did not find any good way to do this, so I simply went into regedit and looked for the plugin entry for Outlook which said “evernote.’ As I have suspected, there were two evernote entries, one for 3.0 and the other for 3.5 so I simply removed one and voila! The evernote Icon was reduced to just one. Do the same for IE plugin(s).