Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing a first image in a sequence of the claimed design; and, FIG. 2 is a front view of a second image thereof. The outermost broken line perimeter shows a display screen or portion thereof with graphical user interface and is included for the purpose of illustrating a portion of the article and forms no part of the claimed design. The remaining broken lines illustrate portions of the graphical user interface and form no part of the claimed design. The appearance of the front view of the display screen or portion thereof with graphical user interface transitions between the images, as shown and described in FIGS. 1 - 2 in the first embodiment. The process or period in which one image transitions to another image forms no part of the claimed design, and any intervening images between the images shown also form no part of the claimed design.