90%+ rubbing alcohol makes a very good solvent for removing things like this. And it’s probably cheaper than goo-gone.
Alcohol solvent can make this worse depending on the adhesive. It can just spread the stuff and thin it out. Someone else suggested oil, that’s the ticket. Bit of olive oil on a rough cloth brings it right up. Wd40 was also suggested, same idea. You want it to move easily, not dissolve.
WD40 is great for dealing with things that are rusted in place, which is what it’s supposed to be used for. It’s just that it’s not a great lubricating oil, and people often recommend it for use as that. Too thin and leaves a waxy residue to repel more water from rusting the surface, which you often don’t want in things that you’re lubricating.