Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing a first embodiment of our new design; FIG. 2 is a front view of a second embodiment thereof; FIG. 3 is a front view of a third embodiment thereof; FIG. 4 is a front view of a fourth embodiment thereof; FIG. 5 is a front view of a fifth embodiment thereof; and, FIG. 6 is a front view of a sixth embodiment thereof. The broken lines in the drawings, including the evenly spaced broken lines, the broken text, and the broken graphics, show portions of the display screen or portion thereof with graphical user interface, and form no part of the claimed design.