Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface, showing a first image of a first embodiment of our new design; and, FIG. 2 is a second embodiment thereof. The outermost broken lines in the figures show a display screen or portion thereof, and form no part of the claimed design. The other broken lines in the figures show portions of the graphical user interface that form no part of the claimed design. In the figures, the grayscale shading represents a contrast in appearance and is not limited to a specific color.