Do goose bumps go away on their own?

They will, and can subside as soon as the stimulus in question stops.