I have a small "ball" on my armpit and it is bothering me. How do I remove it?

You should probably see a dematologist. Could be a small cyst or a large skin tag. I just had some of those removed from my neck. Didn't hurt at all. Better safe than sorry.