Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing the new design; and,

FIG. 2 is a front view of a second embodiment thereof.

The outermost dashed broken lines show an electronic device, which is environmental structure and forms no part of the claimed design. The dot-dash broken lines show a display screen or portion thereof and form no part of the claimed design. The remaining broken lines showing text and portions of the graphical user interface form no part of the claimed design. The gray shading depicts contrast in appearance and is part of the claimed design.