Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing a first embodiment of our new design; FIG. 2 is a second embodiment of the design. FIG. 3 is a third embodiment of the design. FIG. 4 is a fourth embodiment of the design; and, FIG. 5 is a fifth embodiment of the design. The outermost broken lines in the figures show a display screen or portion thereof, and form no part of the claimed design. The other broken lines in the figures show portions of the graphical user interface that form no part of the claimed design.