Display Screen or Portion Thereof with Graphical User Interface

The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee. FIG. 1 is a front view of a display screen or portion thereof with graphical user interface showing my new design thereof; and, FIG. 2 is an enlarged partial view of the bottom side of the display screen or portion thereof with graphical user interface as shown in FIG. 1 . The broken lines shown in FIG. 1 illustrate a display screen or portion thereof and form no part of the claimed design.