Attach (recommended) or Link to PDF file here: N/A

Configuration:
- Web browser and its version: N/A
- Operating system and its version: N/A
- PDF.js version: 4.0.303 [a3637e653]
- Is a browser extension: N/A

Steps to reproduce the problem:
1. Open https://mozilla.github.io/pdf.js/web/viewer.html#page=1
2. Enable InkEditing.
3. Draw something on *the first* page (but do *not* hit e.g. <kbd>Esc</kbd>).
4. Scroll down to the second page.
5. Draw something on *the second* page.
6. Disable InkEditing.
7. Re-enable InkEditing.
8. Select the drawing on *the second* page (works fine).
9. Scroll up to the first page.
10. Try to select the drawing on *the first* page.

What is the expected behavior? (add screenshot)
The drawing becomes selected.

What went wrong? (add screenshot)
You cannot select the previous drawing on *the first* page with the mouse. (Furthermore, if you enable FreeText- or Stamp-Editing instead you can still draw on the page.)

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension): N/A

/cc @calixteman Can you please take a look?
Note that I *suspect* that this might be a regression, but I've unfortunately not had time to bisect yet.

points[i] = trX - points[i + 1];
          points[i + 1] = trY - x;
        }
        break;
      default:
        throw new Error("Invalid rotation");
    }
    return points;
  }
  static #fromPDFCoordinates(points, rect, rotation) {
    const [blX, blY, trX, trY] = rect;
    switch (rotation) {
      case 0:
        for (let i = 0, ii = points.length; i < ii; i += 2) {
          points[i] -= blX;
          points[i + 1] = trY - points[i + 1];
        }
        break;
      case 90:
        for (let i = 0, ii = points.length; i < ii; i += 2) {
          const x = points[i];
          points[i] = points[i + 1] - blY;
          points[i + 1] = x - blX;
        }
        break;
      case 180:
        for (let i = 0, ii = points.length; i < ii; i += 2) {
          points[i] = trX - points[i];
          points[i + 1] -= blY;
        }