If the leaderboard is set to hidden on the main campaign page, it should also be hidden on all peer‑to‑peer pages.
For example, during our Audience Choice fundraiser (where one dollar equals one vote) a single $1,000 donation became visible on a participant's peer‑to‑peer page. Once supporters saw that large jump, many stopped giving because they felt they could no longer catch the leader. We would have raised significantly more if the peer‑to‑peer leaderboards had been hidden as well.
It seems intuitive that disabling the leaderboard on the main campaign page would automatically hide it across all connected peer‑to‑peer pages, but currently that is not the case.