Attach (recommended) or Link to PDF file here:

Configuration:
- Web browser and its version: Chrome 99.0.4772.0 (Official Build) canary (64-bit) (cohort: Clang-64)
- Operating system and its version: Windows 10 Home Version 20H2, OS build 19042.1348
- PDF.js version: 2.12.220
- Is a browser extension: Yes

Steps to reproduce the problem:
1. Open file https://arxiv.org/pdf/2002.04726.pdf
2. Scroll to page 2
3. On top left corner click link  (Kumar et al., 2018)

What is the expected behavior? (add screenshot)
![image](https://user-images.githubusercontent.com/2311076/146633529-c065ade8-52f4-45a3-a461-a660f90d44d0.png)

What went wrong? (add screenshot)
Navigation to a wrong location

![image](https://user-images.githubusercontent.com/2311076/146633574-f4d36619-4ac5-4874-a1bc-2c65b9daa790.png)


Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):

#buf = new Set();
  #size = 0;
  constructor(size) {
    this.#size = size;
  }
  push(view) {
    const buf = this.#buf;
    if (buf.has(view)) {
      buf.delete(view); 
    }
    buf.add(view);
    if (buf.size > this.#size) {
      this.#destroyFirstView();
    }
  }
  /**
   * After calling resize, the size of the buffer will be `newSize`.
   * The optional parameter `idsToKeep` is, if present, a Set of page-ids to
   * push to the back of the buffer, delaying their destruction. The size of
   * `idsToKeep` has no impact on the final size of the buffer; if `idsToKeep`
   * is larger than `newSize`, some of those pages will be destroyed anyway.
   */
  resize(newSize, idsToKeep = null) {