Attach (recommended) or Link to PDF file here:

Configuration:
- Web browser and its version: Chrome 99.0.4772.0 (Official Build) canary (64-bit) (cohort: Clang-64)
- Operating system and its version: Windows 10 Home Version 20H2, OS build 19042.1348
- PDF.js version: 2.12.220
- Is a browser extension: Yes

Steps to reproduce the problem:
1. Open file https://arxiv.org/pdf/2002.04726.pdf
2. Scroll to page 2
3. On top left corner click link  (Kumar et al., 2018)

What is the expected behavior? (add screenshot)
![image](https://user-images.githubusercontent.com/2311076/146633529-c065ade8-52f4-45a3-a461-a660f90d44d0.png)

What went wrong? (add screenshot)
Navigation to a wrong location

![image](https://user-images.githubusercontent.com/2311076/146633574-f4d36619-4ac5-4874-a1bc-2c65b9daa790.png)


Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):

const visible = this._getVisiblePages();
    const visiblePages = visible.views,
      numVisiblePages = visiblePages.length;
    if (numVisiblePages === 0) {
      return;
    }
    const newCacheSize = Math.max(DEFAULT_CACHE_SIZE, 2 * numVisiblePages + 1);
    this.#buffer.resize(newCacheSize, visible.ids);
    this.renderingQueue.renderHighestPriority(visible);
    if (!this.isInPresentationMode) {
      const isSimpleLayout =
        this._spreadMode === SpreadMode.NONE &&
        (this._scrollMode === ScrollMode.PAGE ||
          this._scrollMode === ScrollMode.VERTICAL);
      let currentId = this._currentPageNumber;
      let stillFullyVisible = false;
      for (const page of visiblePages) {
        if (page.percent < 100) {
          break;
        }
        if (page.id === currentId && isSimpleLayout) {
          stillFullyVisible = true;
          break;
        }
      }
      if (!stillFullyVisible) {
        currentId = visiblePages[0].id;