You should be extremely worried as it is probably a melanoma. Get into your vet as soon as possible. Some melanomas can be surgically removed but many have already metastisied.
I just had my Sheltie in for surgery for a black mole that luckily was stage 2 and hopefully they got it all. Cancer is rampant in many dogs and the sooner you get it diagnosed the better the outcome.