Display Screen or Portion Thereof with Icon Set

FIG. 1 is a front view of a first embodiment of a display screen or a portion thereof with an icon set; and,

FIG. 2 is a front view of a second embodiment of a display screen or a portion thereof with an icon set.

The broken lines shown in the drawing-illustrate a display screen or a portion thereof that form no part of the claimed design. The solid line brackets indicate an icon set. The elements of the set are arranged relatively on the drawing sheet for the convenience of illustration, and the placement of each element relative to another, or to the drawing sheet, form no part of the claimed design.