I am not sure exactly what is going on here, and you will need to see your primary care doctor
or a dermatologist
to confirm a diagnosis, because this is of some concern.
If the bumps that you are talking about are soft, mobile, narrow projections that stick up from the skin, the most likely diagnosis would be skin tags. These are benign growths of the skin that tend to occur in areas of friction (such as under the arms). There may be a genetic predisposition to develop skin tags, but they do not need to be treated unless they become uncomfortable or otherwise a nuisance, in which case your primary care doctor should be able to remove them in the office.
Another potential cause would be a viral infection of the skin. There are two common conditions caused by viral infections of the skin, warts
and molluscum contagiosum. Both of the conditions are spread by scratching or touching the spots, so it is important to have your doctor confirm the diagnosis. If these do turn out to be either warts or molluscum, it is possible to freeze them or otherwise intervene so that they go away more quickly. Again, please discuss with your doctor!