Display Screen or Portion Thereof with Graphical User Interface

The sole FIGURE is a front view of a display screen or portion thereof with graphical user interface showing the new design. The outermost evenly-dashed broken lines show an electronic device, which is the environment of the claim and forms no part of the claimed design. The dot-dashed broken lines adjacent to the outermost evenly-dashed broken lines show a display screen or portion thereof and form no part of the claimed design. The remaining broken lines in the drawing show portions of the graphical user interface and form no part of the claimed design. The gray shading depicts contrast in appearance and is part of the claimed design.