### Description

Spark-submit 
--queue thequeue option specifies the YARN queue to which the application should be submitted.


more  - https://spark.apache.org/docs/3.2.0/running-on-yarn.html

### Use case/motivation


The --queue option is particularly useful in a multi-tenant environment where different users or groups have allocated resources in specific YARN queues.

### Related issues

_No response_

### Are you willing to submit a PR?

- [X] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)

"""
        Process the log files and extract useful information out of it.
        If the deploy-mode is 'client', log the output of the submit command as those
        are the output logs of the Spark worker directly.
        Remark: If the driver needs to be tracked for its status, the log-level of the
        spark deploy needs to be at least INFO (log4j.logger.org.apache.spark.deploy=INFO)
        :param itr: An iterator which iterates over the input of the subprocess
        """
        
        for line in itr:
            line = line.strip()
            
            
            if self._is_yarn and self._connection["deploy_mode"] == "cluster":
                match = re.search("application[0-9_]+", line)
                if match:
                    self._yarn_application_id = match.group(0)
                    self.log.info("Identified spark driver id: %s", self._yarn_application_id)
            
            
            elif self._is_kubernetes:
                match = re.search(r"\s*pod name: ((.+?)-([a-z0-9]+)-driver)", line)
                if match:
                    self._kubernetes_driver_pod = match.group(1)
                    self.log.info("Identified spark driver pod: %s", self._kubernetes_driver_pod)
                
                match_exit_code = re.search(r"\s*[eE]xit code: (\d+)", line)
                if match_exit_code:
                    self._spark_exit_code = int(match_exit_code.group(1))