For a daily driver or a fast road/track car I would say def keep it
For a dedicated track only car, trailered to and from the track etc then it can be worth removing to save weight and take a belt drive away from the engine, also helps improve steering feel
Still when moving slowly about the pits and parking etc it’s a pain