Display Screen or Portion Thereof with Graphical User Interface

The file of this patent or application contains at least one drawing executed in color. Copies of this patent of application with color drawing(s) will be provided by the Office upon request and payment of the necessary fee. FIG. 1 is a front view of a display screen or portion thereof with graphical user interface in accordance with a first embodiment of the claimed design; and, FIG. 2 is a front view of the display screen or portion thereof with graphical user interface in accordance with a second embodiment of the claimed design. The outer dashed broken-line border illustrates the perimeter of the display screen or portion thereof and forms no part of the claimed design. The dotted broken lines illustrate portions of the graphical user interface and form no part of the claimed design.