Attach (recommended) or Link to PDF file here: N/A

Configuration:
- Web browser and its version: N/A
- Operating system and its version: N/A
- PDF.js version: 4.0.303 [a3637e653]
- Is a browser extension: N/A

Steps to reproduce the problem:
1. Open https://mozilla.github.io/pdf.js/web/viewer.html#page=1
2. Enable InkEditing.
3. Draw something on *the first* page (but do *not* hit e.g. <kbd>Esc</kbd>).
4. Scroll down to the second page.
5. Draw something on *the second* page.
6. Disable InkEditing.
7. Re-enable InkEditing.
8. Select the drawing on *the second* page (works fine).
9. Scroll up to the first page.
10. Try to select the drawing on *the first* page.

What is the expected behavior? (add screenshot)
The drawing becomes selected.

What went wrong? (add screenshot)
You cannot select the previous drawing on *the first* page with the mouse. (Furthermore, if you enable FreeText- or Stamp-Editing instead you can still draw on the page.)

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension): N/A

/cc @calixteman Can you please take a look?
Note that I *suspect* that this might be a regression, but I've unfortunately not had time to bisect yet.

);
      this.#isCanvasInitialized = true;
      this.#setCanvasDims();
      this.setDims(this.width * parentWidth, this.height * parentHeight);
      this.#redraw();
      this.div.classList.add("disabled");
    } else {
      this.div.classList.add("editing");
      this.enableEditMode();
    }
    this.#createObserver();
    return this.div;
  }
  #setCanvasDims() {
    if (!this.#isCanvasInitialized) {
      return;
    }
    const [parentWidth, parentHeight] = this.parentDimensions;
    this.canvas.width = Math.ceil(this.width * parentWidth);
    this.canvas.height = Math.ceil(this.height * parentHeight);
    this.#updateTransform();
  }
  /**
   * When the dimensions of the div change the inner canvas must
   * renew its dimensions, hence it must redraw its own contents.
   * @param {number} width - the new width of the div
   * @param {number} height - the new height of the div
   * @returns
   */
  setDimensions(width, height) {