Display Screen or Portion Thereof with Graphical User Interface

FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing a first image in a sequence of the claimed design; FIG. 2 is a second image thereof; and, FIG. 3 is a third image thereof. The appearance of the transitional graphical user interface sequentially transitions between the images shown in FIG. 1 - 3 . The process or period in which one image transitions to another image forms no part of the claimed design. The dot-dot-dash broken lines illustrate a display screen or portion thereof and form no part of the claimed design. The dot-dash broken lines illustrate portions of the graphical user interface that form no part of the claimed design. The broken-line text illustrated within each dashed rectangle represents unclaimed environmental matter and forms no part of the claimed design.