Attach (recommended) or Link to PDF file here: N/A

Configuration:
- Web browser and its version: N/A
- Operating system and its version: N/A
- PDF.js version: 4.0.303 [a3637e653]
- Is a browser extension: N/A

Steps to reproduce the problem:
1. Open https://mozilla.github.io/pdf.js/web/viewer.html#page=1
2. Enable InkEditing.
3. Draw something on *the first* page (but do *not* hit e.g. <kbd>Esc</kbd>).
4. Scroll down to the second page.
5. Draw something on *the second* page.
6. Disable InkEditing.
7. Re-enable InkEditing.
8. Select the drawing on *the second* page (works fine).
9. Scroll up to the first page.
10. Try to select the drawing on *the first* page.

What is the expected behavior? (add screenshot)
The drawing becomes selected.

What went wrong? (add screenshot)
You cannot select the previous drawing on *the first* page with the mouse. (Furthermore, if you enable FreeText- or Stamp-Editing instead you can still draw on the page.)

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension): N/A

/cc @calixteman Can you please take a look?
Note that I *suspect* that this might be a regression, but I've unfortunately not had time to bisect yet.

this.#realWidth = width;
    this.#realHeight = height;
    this.setDims(width, height);
    const unscaledPadding = firstTime ? padding / this.scaleFactor / 2 : 0;
    this.translate(
      prevTranslationX - this.translationX - unscaledPadding,
      prevTranslationY - this.translationY - unscaledPadding
    );
  }
  
  static deserialize(data, parent, uiManager) {
    if (data instanceof InkAnnotationElement) {
      return null;
    }
    const editor = super.deserialize(data, parent, uiManager);
    editor.thickness = data.thickness;
    editor.color = Util.makeHexColor(...data.color);
    editor.opacity = data.opacity;
    const [pageWidth, pageHeight] = editor.pageDimensions;
    const width = editor.width * pageWidth;
    const height = editor.height * pageHeight;
    const scaleFactor = editor.parentScale;
    const padding = data.thickness / 2;
    editor.#disableEditing = true;
    editor.#realWidth = Math.round(width);
    editor.#realHeight = Math.round(height);
    const { paths, rect, rotation } = data;
    for (let { bezier } of paths) {
      bezier = InkEditor.#fromPDFCoordinates(bezier, rect, rotation);
      const path = [];