Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a first embodiment of a display screen or portion thereof with graphical user interface showing our new design; and, FIG. 2 is a front view of a second embodiment of a display screen or portion thereof with graphical user interface showing our new design. The outermost broken lines in the figures show a display screen or portion thereof, and form no part of the claimed design. The other broken lines in the figures show portions of the graphical user interface that form no part of the claimed design. The figures are illustrated to show contrasting appearance. Areas of the display screen or portion thereof with a graphical user interface that appear in different shades of gray represent areas with contrasting appearances.