Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a first embodiment of a display screen or portion thereof with graphical user interface showing my new design; FIG. 2 is a front view of a second embodiment of a display screen or portion thereof with graphical user interface showing my new design; and, FIG. 3 is a front view of a third embodiment of a display screen or portion thereof with graphical user interface showing my new design. The dash-dash broken lines shown in the figures are for illustrative purposes only and form no part of the claimed design. The dash-dot broken lines shown in the figures depict a portion of the display screen and form no part of the claimed design.