Attach (recommended) or Link to PDF file here:

Configuration:
- Web browser and its version: Chrome 99.0.4772.0 (Official Build) canary (64-bit) (cohort: Clang-64)
- Operating system and its version: Windows 10 Home Version 20H2, OS build 19042.1348
- PDF.js version: 2.12.220
- Is a browser extension: Yes

Steps to reproduce the problem:
1. Open file https://arxiv.org/pdf/2002.04726.pdf
2. Scroll to page 2
3. On top left corner click link  (Kumar et al., 2018)

What is the expected behavior? (add screenshot)
![image](https://user-images.githubusercontent.com/2311076/146633529-c065ade8-52f4-45a3-a461-a660f90d44d0.png)

What went wrong? (add screenshot)
Navigation to a wrong location

![image](https://user-images.githubusercontent.com/2311076/146633574-f4d36619-4ac5-4874-a1bc-2c65b9daa790.png)


Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):

if (this._scrollMode === ScrollMode.PAGE) {
      if (pageNumber) {
        
        this._setCurrentPageNumber(pageNumber);
      }
      this.#ensurePageViewVisible();
      
      
      this.update();
    }
    if (!pageSpot && !this.isInPresentationMode) {
      const left = pageDiv.offsetLeft + pageDiv.clientLeft;
      const right = left + pageDiv.clientWidth;
      const { scrollLeft, clientWidth } = this.container;
      if (
        this._scrollMode === ScrollMode.HORIZONTAL ||
        left < scrollLeft ||
        right > scrollLeft + clientWidth
      ) {
        pageSpot = { left: 0, top: 0 };
      }
    }
    scrollIntoView(pageDiv, pageSpot);
  }
  /**
   * Prevent unnecessary re-rendering of all pages when the scale changes
   * only because of limited numerical precision.
   */
  #isSameScale(newScale) {