### Preflight Checklist

- [X] I have read the [Contributing Guidelines](https://github.com/electron/electron/blob/master/CONTRIBUTING.md) for this project.
- [X] I agree to follow the [Code of Conduct](https://github.com/electron/electron/blob/master/CODE_OF_CONDUCT.md) that this project adheres to.
- [X] I have searched the [issue tracker](https://www.github.com/electron/electron/issues) for a feature request that matches the one I want to file, without success.

### Electron Version

12.0.7

### What operating system are you using?

Ubuntu

### Operating System Version

5.4.0-73-generic #82~18.04.1-Ubuntu

### What arch are you using?

x64

### Last Known Working Electron version

_No response_

### Expected Behavior

`const existingPermissions = await navigator.serial.getPorts();` should return a list of serial ports for which permission has already been granted, even when a device has been unplugged and plugged back in again.

### Actual Behavior

The list is empty, even when the same code works in the browser (Chromium v90.0.4430.93).

### Testcase Gist URL

https://gist.github.com/gniezen/34950a5fa84dcf000e2b55a8d599ecd6

### Additional Information

To reproduce using gist:

- Replace `usbVendorId` and `usbProductId` with that of your test device.
- Click the `Connect` button. It should show up in the port list on the main console.
- Click the `Get Ports` button. It should show the existing permission in the developer console.
- Unplug and re-plug the device.
- Click the `Get Ports` button. It should show the existing permissions, but returns an empty list.
shell/browser/serial/electron_serial_delegate.cc
Observer* observer) {
  SerialChooserContext* serial_chooser_context = GetChooserContext(frame);
  if (serial_chooser_context) {
    return serial_chooser_context->RemovePortObserver(observer);
  }
}
SerialChooserController* ElectronSerialDelegate::ControllerForFrame(
    content::RenderFrameHost* render_frame_host) {
  auto mapping = controller_map_.find(render_frame_host);
  return mapping == controller_map_.end() ? nullptr : mapping->second.get();
}
SerialChooserController* ElectronSerialDelegate::AddControllerForFrame(
    content::RenderFrameHost* render_frame_host,
    std::vector<blink::mojom::SerialPortFilterPtr> filters,
    content::SerialChooser::Callback callback) {
  auto* web_contents =
      content::WebContents::FromRenderFrameHost(render_frame_host);
  auto controller = std::make_unique<SerialChooserController>(
      render_frame_host, std::move(filters), std::move(callback), web_contents,
      weak_factory_.GetWeakPtr());
  controller_map_.insert(
      std::make_pair(render_frame_host, std::move(controller)));
  return ControllerForFrame(render_frame_host);
}
void ElectronSerialDelegate::DeleteControllerForFrame(
    content::RenderFrameHost* render_frame_host) {
  controller_map_.erase(render_frame_host);
}
}