Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or a portion thereof with graphical user interface showing a first embodiment of our design. FIG. 2 is a front view of a display screen or a portion thereof with graphical user interface for showing a second embodiment of our design. FIG. 3 is a front view of a display screen or a portion thereof with graphical user interface showing a third embodiment of our design; and, FIG. 4 is a front view of a display screen or a portion thereof with graphical user interface showing a fourth embodiment of our design. The outermost broken lines in the drawings represent a display screen or portion thereof and form no part of the claimed design. All remaining broken lines in the drawings illustrate portions of the graphical user interface that form no part of the claimed design.