\section{Introduction}

Nowadays, spoken language understanding (SLU) systems are crucial for daily life communication, where they can provide the crucial vocal user interface to home-controller devices and other appliances. The role of an SLU system is to convert a given speech signal to a structured representation, such as in the form of intent/slots classes, that could be interpreted  by a software and application to ultimately perform an action on the target device  \cite{tur2011spoken,bapna-etal-2017-sequential}. For example, a speech signal like `set an alarm for 5 p.m.' might have the following representation \{intent: `SET\_ALARM', data\_time: `5 P.M.'\}.

In classical SLU systems, an automatic speech recognition (ASR) model is first used to transcribe speech signals to a word string, followed by a natural language understanding (NLU) model that classifies this word string to the target intent representation. While this approach works well in various scenarios, there are a number of problems. For instance, as mentioned in \cite{8461718, ghannay:hal-01987740}, the two models, ASR and NLU, are often trained independently and not jointly optimized. Most ASR systems in themselves consists of a number of dis-jointly trained components. These issues can affect the overall performance of the SLU systems. Furthermore, these models often have high data and computational requirements, limiting their applicability to a handful of use-cases and languages.

The number of recent end-to-end and ASR-free SLU systems show promising results \cite{haghani2018audio, lugosch2019speech, 8268987,Serdyuk2018TowardsES}. These SLU systems map a speech signal directly to the speaker's intent without explicitly recognizing the corresponding text. As with the conventional ASR+NLU systems, the end to end SLU systems are often computationally demanding. For example, the SLU systems presented in \cite{haghani2018audio, lugosch2019speech, 8268987,Serdyuk2018TowardsES} give good performance in terms of the recognition accuracy, however, they are a combination of several neural networks with each having hundreds of millions of parameters. Running such systems in real-time on low-power devices is not feasible.

In this work, we present an efficient and compact end-to-end SLU system. The proposed system is targeted at low-footprint devices, where the entire speech data is processed on the device without the need to send any data to a cloud server. By processing the entire speech data on the device, such a system provides increased privacy for the user. Furthermore, such a system can enable voice user interfaces for a number of use-cases and applications that would not have been possible in an always-connected scenario.  There are a number of technical contributions in this work that provide the aforementioned advantages. These are summarized below.

\begin{itemize}
    \item In order to have the low latency property, the proposed model process a given input speech signal segment-by-segment. Here, the processing of one segment is done while receiving the upcoming one. The processing begins even if the speech signal is not entirely received.

    \item The proposed model is built using convolutional layers, which are less computationally expensive than recurrent layers \cite{gao2019edgedrnn, zhang2015characterlevel,bai2018empirical}.

    \item The proposed model can process speech signals of variable duration without requiring any padding or cutting of the incoming speech.

\end{itemize}

\section{Related work}

In this section, we present the current state-of-the-art of the end-to-end SLU systems.

In \cite{8461718}, the proposed SLU system is a speech-to-intent approach tested for semantic classification in dialog systems. In this system, the given speech signals are mapped directly to semantic meaning. This has several advantages. First, richer information than words can be extracted from speech. Second, the ability to extract semantic meaning from mixed language speech. The model proposed in \cite{8461718}, is composed of an acoustic model pre-trained with CTC loss to predict graphemes, and a semantic model pre-trained with the outputs of the acoustic model to predict intents. Once the two models are pre-trained, a full pipeline training (i.e., a fine tuning) is done on the entire architecture.  In \cite{lugosch2019speech}, a similar framework to \cite{8461718} is proposed, which is composed of three models. The three models are pre-trained respectively with phonemes, words, and intents. Then, they are fine tuned by training them together.

As opposed to \cite{8461718, lugosch2019speech}, in \cite{Serdyuk2018TowardsES} no pre-training is used, which is similar to our model. Here in \cite{Serdyuk2018TowardsES}, an encoder-decoder framework is proposed. The encoder is a multi-layer bidirectional recurrent layers. The decoder maps the output of the encoder to its corresponding intent class. To reduce the computational time, Serdyuk et al. used a sub-sampling for the Hidden activations along the time domain \cite{bahdanau2014neural, 44926}.

Recently,  Haghaniet et al. \cite{haghani2018audio} proposed and compared four different SLU encoder-decoder based approaches, which are augmented by the attention mechanism \cite{bahdanau2014neural}. In all these proposed approaches, the mapping of speech signals to intents is formulated as a sequence-to-sequence problem \cite{SutskeverVL14, ChoMGBSB14}. The first approach maps audio features directly to their corresponding semantic sequence (domain/intent/arguments). In the second approach, the decoder outputs, for a given speech signal, not only its corresponding semantic sequence, but also its sequence of graphemes. The third has two decoder models: one outputs its semantic sequence and another outputs its sequence of graphemes. In the last one, called a multistage model, two stages are used where, in the first stage, the transcript is predicted, and in the second stage, the semantics are predicted. Here, the two stages are independently optimized and afterwards the whole system is fine tuned together. Haghaniet et al. \cite{haghani2018audio} conclude, after evaluations on real-world scenarios, that having an intermediate text representation and jointly optimizing the full system improves the overall accuracy of prediction.

In all these approaches \cite{8461718, lugosch2019speech, Serdyuk2018TowardsES, haghani2018audio}, the proposed network architectures are heavily based on recurrent layers, which may not be well suited for low-power devices \cite{Amoh2019AnOR}. These types of layers are slower and less computationally efficient than convolutional layers \cite{gao2019edgedrnn, zhang2015characterlevel,bai2018empirical}.

\section{Proposed Approach}
This section presents the proposed architecture along with problem formulation and the relevant implementation details.
\subsection{Problem formulation}

The speech-to-intent model proposed in this work is composed of a sequence of convolutional layers followed by a global max-pooling layer and few fully connected layers that output the intent class (see Table \ref{table_CNN_arch}). Here, the global max-pooling layer has crucial importance since it allows processing any given input speech signal segment-by-segment without the need to have it entirely at the moment of processing. In addition, this layer allows to process speech signals with different variable length, where no padding or concatenating is demanded.

In Figure \ref{fig:tradvsseg}, we show the difference between processing a full speech signal versus segment-by-segment speech signal processing (i.e., the proposed scenario). As is shown, in the full-signal scenario, we wait till receiving the full speech signal then we process it (i.e., forwarded it through the model). However, in segment-by-segment signal processing scenario, each segment is forwarded separately through the convolutional layers and the global max-pooling layer. Then, all the outputs of all segments are stacked together and we again apply the max-pooling through them and we forward the resulting vector through the fully connected layers to classify the intent. Here, the advantage is that we can process one segment, while we are receiving the upcoming one. This results in less processing time, since a large part of the processing is done while receiving the speech signal.

For example, let $\{I_0,\ldots,I_T\}$ be the input acoustic features sequence for a given speech signal.

\begin{itemize}
    \item In the full-signal processing scenario, the convolutional layers output a sequence $\{f_0,\ldots,f_N\}$ then the global max-pooling layer pool this sequence of outputs to one vector $R$, which is mapped by the fully connected layers to the intent class.

    \item In the segment-by-segment speech signal scenario (i.e., Algorithm \ref{algoTra}), the input acoustic features sequence can be viewed as two segments $\{I_0,\ldots,I_T\}= \{I_0,\ldots,I_s\} \cup \{I_{s+1},\ldots,I_T\}$, (i.e., in this example, there is no overlapping between segments). The convolutional layers output two sequence $\{f_0,\ldots,f_n\}$ and $\{f_0,\ldots,f_m\}$ for the two segments. Then, a global max-pooling layer pool the two sequences of outputs to two vector $R_1$ and $R_2$. In the last step, we apply again the global max-pooling for $\{R_1,R_2\}$ and outputs one vector $R$, which is mapped through the fully connected layers to the intent class.
\end{itemize}

\begin{algorithm}[h]
\SetAlgoLined
	\KwIn{A stream input speech signals.}
	\KwOut{The intent class.}
	$T$=[]\;
    \While {waiting the upcoming segment ($S_{i+1}$)}
    {
    $R_i$=global-max-pooling(Conv-layers($S_i$))\;
    $T$=[$T$,$R_i$]\;
    }
    $R$=global-max-pooling(T)\;
    output=fully-connected($R$)\;
	\Return{output}
\caption{The segment-by-segment speech signal processing algorithm.}
\label{algoTra}
\end{algorithm}

The segment by segment processing is only used in the inference time. However, in the training time, the complete signal is processed at once. In the full-signal processing scenario, we need a total time of $T + \beta$ (seconds), where $T$ is the time to receive the speech signal and $\beta$ is the processing time. However, in the segment-by-segment speech signal scenario, the proposed approach needs less processing time. Since a part of the processing is done when receiving the speech signal. Here, the exact processing time depends on the two hyper-parameters: segment size and step size; these represent the size of the segment to process it each time and the size between the beginnings of two consecutive segments, respectively.

\makeatletter
\newcommand*{\centerfloat}{%
  \parindent \z@
  \leftskip \z@ \@plus 1fil \@minus \textwidth
  \rightskip\leftskip
  \parfillskip \z@skip}
\makeatother

\begin{figure*}[ht!]
	\centerfloat
	\begin{footnotesize}

	\mbox{
		\shortstack{\fbox{\includegraphics[width=0.5\linewidth]{Slide1.jpg}} \\[3mm]
		    a) Full-signal processing scenario.
		}

		\hspace{5mm}

		\shortstack{\fbox{\includegraphics[width=0.5\linewidth]{Slide3.jpg}} \\[3mm]
		    b) Segment-by-segment signal processing scenario (the proposed approach).
		}
    }
    \end{footnotesize}
	\caption{A comparison between traditional approaches that encode speech signal after receiving it fully and the proposed approach that encodes it segment-by-segment while receiving it. The first approach needs a total time \boldsymbol{$T + \beta$} (seconds) (T is the long of the speech signal), while the proposed approach needs a \boldsymbol{$T + \alpha$} (seconds). Here, \boldsymbol{$\beta>\alpha$} since a part of the processing is done when receiving the speech signal, which gives a low-latency SLU system.}
	\label{fig:tradvsseg}
	\vspace{-1em}
\end{figure*}

\subsection{The proposed network architecture}

Table \ref{table_CNN_arch} presents details about the proposed network architecture. Here, the global max-pooling layer is a critical component. It allows processing speech signals of variable duration segment-by-segment.  The proposed network is composed of 17 layers in total, with 8 convolutional layers, 4 max-pooling layers, 1 global max-pooling layer, and 4 fully-connected layers. All hidden layers use rectified linear units (ReLU) \cite{BengioCV13}. Moreover, as recommended in \cite{IoffeS15}, batch normalization is applied before each activation layer. The 8 convolutional layers with the 4 max-pooling layers can be viewed as 4 blocks. Where, each block is composed of one convolutional layer followed by a max-pooling layer of $(2\times1)$ kernel and a convolutional layer of $(1\times1)$ kernel. The  $(1\times1)$ convolutional layer is used mainly to reduce the number of features and to keep a small-footprint model.

\begin{table}[ht]
\centering
\renewcommand{\arraystretch}{1}
\caption{The CNN architecture for speech segment of \\ size $100 \times 41$ (1 second).}
\label{table_CNN_arch}
\begin{footnotesize}
\begin{tabular}{lc}
\toprule
\textbf{Layer type} & \textbf{Output shape} \\
\midrule\midrule
4$\times$41, Conv2D, 128  & \fsz{128}{97}{1} \\
Max-pooling  &  \fsz{128}{48}{1} \\
1$\times$1, Conv2D, 64  & \fsz{64}{48}{1} \\
\midrule
4$\times$1, Conv2D, 128  & \fsz{128}{45}{1} \\
Max-pooling  &  \fsz{128}{22}{1} \\
1$\times$1, Conv2D, 64  & \fsz{64}{22}{1} \\
\midrule
4$\times$1, Conv2D, 128  & \fsz{128}{19}{1} \\
Max-pooling  &  \fsz{128}{9}{1} \\
1$\times$1, Conv2D, 64  & \fsz{64}{9}{1} \\
\midrule
4$\times$1, Conv2D, 256  & \fsz{256}{6}{1} \\
Max-pooling  &  \fsz{256}{3}{1} \\
1$\times$1, Conv2D, 256  & \fsz{256}{3}{1} \\
\midrule
\textbf{Global max pooling} & \textbf{256} \\
Fully-connected ~(ReLU units) & 256  \\
Fully-connected ~(ReLU units) & 196  \\
Fully-connected ~(ReLU units) & 128  \\
Fully-connected ~(Softmax) & 31$^*$\\
\midrule
\bottomrule
\multicolumn{2}{l}{$^*$ \emph{Number of intents in the Fluent  Speech  Commands dataset}.}
\vspace{-2em}
\end{tabular}
\end{footnotesize}
\end{table}

In Table \ref{table_CNN_arch}, an input of size $(100 \times 41)$ is used. This input represents one second of speech, where the acoustic features are extracted each 10ms for a speech signal frame sized of 25ms. The 41 elements are the 40 filters banks and the energy measure for the corresponding frame. As mentioned in \cite{VIIKKI1998133}, applying the cepstral mean and variance normalization (CMVN) on these 41 features improves speech recognition/classification performances. This normalization reduces the environmental changes and mismatch between the training and the testing conditions, where different background noises or different microphones can be presented.  In full-signal processing scenario, the CMVN is usually applied at the utterance level. However, in the proposed segment-by-segment speech signal scenario, utterance CMVN can not be applied because it requires having received the whole speech signal in the moment of processing.  Instead, we use globally computed mean and variance with all the training data \cite{Zeyer2016TowardsOW, 6707746}.

\section{Results}

 \begin{table}[ht]
  	\centering
 	\renewcommand{\arraystretch}{0.9}
 	\caption{Information  about  the  Fluent  Speech  Commands dataset.}
 	\label{table_dataset}
 		\begin{footnotesize}
 		\begin{tabular}{lccc}
 			\toprule
 			\textbf{Split} & \textbf{\# of speakers} & \textbf{\# of utterances} & \textbf{\# hours}   \\
 			\midrule\midrule
 			 Train & 77 & 23,132 & 14.7 \\
 			 Validation & 10 & 3,118 & 1.9 \\
 			 Test & 10 & 3,793 & 2.4 \\
 			\midrule
 			 \\
             Total & 97 & 30.043 & 19.0 \\
            \midrule
            \bottomrule
 		\end{tabular}
 		\end{footnotesize}
 \end{table}

This section summaries the experiments conducted in this work. First, we present the performance in terms of recognition accuracy of the proposed approach on the publicly available Fluent Speech Commands dataset \cite{lugosch2019speech}. Table \ref{table_dataset} summarizes some information about the dataset. Next, we evaluated the impact of different CMVN optimizations on the recognition accuracy. Finally, we evaluate the impact of various hyper-parameters on the proposed approach.

 \subsection{Comparison to state-of-the-art}

 \begin{table}[h]
  	\renewcommand{\arraystretch}{1.2}
  	\caption{ Error rate on the clean testing set comparing to state-of-the-art models using the Fluent Speech Commands dataset.}
  	\label{table_comp}
  	\centering

  	\begin{footnotesize}
  		\begin{tabular}{lcc}
  			\toprule
  			\textbf{Method} & \textbf{clean} & \textbf{Model size}  \\
  			\midrule \midrule
             Lugosch et al. (Full pipeline) \cite{lugosch2019speech} & 1.2\%  & 14.6M \\
             Lugosch et al. (No pre-training) \cite{lugosch2019speech} & 3.6\%  &  14.6M \\
             Poncelet et al. (Capsule net) \cite{poncelet2020multitask} & 1.9\%  &  - \\
             Palogiannidi et al. \cite{palogiannidi2019endtoend} & 1.38\%-5.83\%  &  - \\
            \midrule
             Proposed model & 2.18\%  &  \textbf{1.3M} \\
            \midrule
  			\bottomrule
  		\end{tabular}
  		\end{footnotesize}

\end{table}

Table \ref{table_comp} presents the results in terms of command recognition accuracy on the clean Fluent Speech Commands test set for the proposed approach along with other works from recent research. Lugosch et al. in \cite{lugosch2019speech} used a model composed of a hierarchy of sub-networks. The first sub-network is trained to recognize phonemes from acoustic features. The second one is trained to recognize words from phonemes. The last one is trained to recognize intents from words. In the full pipeline scenario, Lugosch et al. first pre-trained the three sub-networks separately then the entire model is fine-tuned. Our approach can be compared to the approach of Lugosch et al. \cite{lugosch2019speech}, where no pre-trained model is used. We can observer from the table that our approach has better performance (+1.42\%). In addition, our model is only $1.3 MB$ in size compared to $14.6 MB$ for Lugosch's model. The work of Poncelet el al. \cite{poncelet2020multitask} has a comparable performance to ours (1.9\% vs 2.18\%) similar to the work of Palogiannidi et al. \cite{palogiannidi2019endtoend}, which has performances between 1.38\% and 5.83\% depending on the number and the types of the recurrent layers. Our approach is more appropriate for low-power devices since it is built from only convolutional layers, where the models of \cite{lugosch2019speech,poncelet2020multitask,palogiannidi2019endtoend} includes many recurrent layers, which are slower compared to convolutional layers \cite{gao2019edgedrnn, zhang2015characterlevel,bai2018empirical}.

\subsection{Comparison of using different CMVN normalization}

\begin{figure}[h]
	\centering
		\includegraphics[width=0.9\linewidth]{Figure_1_small.png}
	\caption{Validation loss for no CMVN, Global CMVN and Utterance CMVN models.}
	\label{CMVN}
\end{figure}

Figure \ref{CMVN} shows the validation losses for the three models trained respectively, with global CMVN, utterance CMVN and without any CMVN (No-CMVN). We can see that applying the global CMVN and utterance CMVN has almost the same performance. However, in the segment-by-segment processing scenario, we cannot apply utterance based CMVN, therefore, our only options are either applying the global CMVN or no CMVN at all. It is evident from the results in the Table \ref{table_cmvn} that applying the global CMVN leads to a higher performance. In the table, the column labeled `5dB' represents the testing case when the Fluent dataset is enhanced by augmenting with a mix noise types with a signal-to-noise ratio of 5dB. The `5dB + ff' scenario refers to the `5dB' set that is further augmented by a set of real Room Impulse Responses (RIRs). For the rest of this paper, all the experiments are performed with the global CMVN model. This is also true for the results presented for the proposed algorithm in Table \ref{table_comp}.

 \begin{table}[H]
  	\renewcommand{\arraystretch}{1.2}
  	\caption{ Error rate on the testing set for no CMVN, Global CMVN and Utterance CMVN models.}
  	\label{table_cmvn}
  	\centering

  	\begin{footnotesize}
  		\begin{tabular}{lccc}
  			\toprule
  			\textbf{Method} & \textbf{clean} & \textbf{5dB} & \textbf{5dB + ff} \\
  			\midrule \midrule
             no CMVN & 2.18\%  & 10.23\% & 19.11\% \\
             Global CMVN & \textbf{2.18\%}  & \textbf{9.96\%} & \textbf{18.98\%} \\
             \midrule
             Utterance CMVN & 2.48\%  & 9.1\% & 18.4\% \\
  			 \midrule
  			 \bottomrule
  		\end{tabular}
  		\end{footnotesize}

\end{table}

\subsection{Hyper-parameters analysis}

There are two main hyper-parameters in the segment-by-segment signal processing scenario. The first is the segment size, $S$, that represents the size of the audio segment to process. The second is the step size, $T$, that represents the amount which the window is moved between two consecutive segments. This means that each $T$ seconds, we process the last $S$ seconds till the ending of the speech signal. When, the step size is less than the segment size, this means that there is an overlapping between the segments.

\begin{table}[H]
  	\renewcommand{\arraystretch}{1.2}
  	\caption{Mean Error rate on the (clean, 5dB and 5dB+ff) testing set for the segment-by-segment signal processing scenario using different hyper-parameters values.}
  	\label{table_hyper}
  	\centering
  	\resizebox{\columnwidth}{!}{
  	\begin{footnotesize}
  		\begin{tabular}{cccccc}
  			\toprule
  			\textbf{(Step $T\downarrow$ / Segment $S\rightarrow$)} & \textbf{1s} & \textbf{1.25s} & \textbf{1.5s} & \textbf{1.75s} & \textbf{2s}\\
  			\midrule \midrule
            \textbf{0.25s}  & \textbf{10.47\%}  & 10.61\% & 10.81\% & 10.81\% & 10.8\%\\
            \textbf{0.5s}   & 10.57\%  & 10.64\% & 10.54\% & \textbf{10.51\%} & 10.53\%\\
            \textbf{0.75s}  & 24.38\%  & 10.81\% & 10.47\% & \textbf{10.26\%} & 11.07\%\\
            \textbf{1s}     & 46.63\%  & 17.53\% & 11.43\% & 10.54\% & \textbf{10.53\%}\\
            \textbf{1.25s}  & 61.49\%  & 34.67\% & 20.85\% & \textbf{17.43\%} & 13.95\%\\
            \textbf{1.5s}   & 69.42\%  & 49.56\% & 38\%    & 15.93\% & \textbf{11.49\%}\\
  			\midrule
  			\bottomrule
  		\end{tabular}
  		\end{footnotesize}
    }
\end{table}

Table \ref{table_hyper} shows that smaller step size, and hence the overlapping between segments, is crucial. A small step size means more information to encode, while information can be seen in different segments. This results in a better and richer representation. On the other hand, a higher step size means less computation. However, since a segment is processed while the system is receiving the next segment, having a high step size is not beneficial. Furthermore, we can observe that using a high segment size is not always beneficial. A small segment size also is not preferred since it can effect the overlapping. To conclude, the best hyper-parameters combination is the one that preserve a higher overlapping between segments.

\begin{table}[H]
 	\caption{Mean Error rate on the (clean, 5dB and 5dB+ff) testing set for the segment-by-segment signal processing scenario versus the full-signal processing scenario.}
  	\centering
  	\resizebox{\columnwidth}{!}{
 	\label{table_segvsfull}
 		\begin{footnotesize}
 		\begin{tabular}{lcc}
 			\toprule
 			\textbf{hyper-parameters } & \textbf{Mean Error rate} & \textbf{\thead{Time of processing needed\\ after fully receiving the speech signal (\%)}}  \\
 			\midrule\midrule
 			 (Segment, Step)=(1.75s, 0.75s) & \textbf{10.26\%} & 43\% \\
 			 (Segment, Step)=(1s, 0.25s) & 10.47\% & \textbf{25\%} \\
 			 \midrule
 			 Full signal speech & 10.37\% & 100\% \\
            \midrule
            \bottomrule
 		\end{tabular}
 		\end{footnotesize}
 }
 \end{table}

Table \ref{table_segvsfull} shows the difference in performances between the segment-by-segment signal processing scenario and the full signal processing scenario. We can see that the segment-by-segment processing not only reduces the time of processing but also improves the performance (10.26\% vs 10.37\%). Here, the time of processing needed after fully receiving the speech signal is represented as a percentage. In full signal processing scenario (Figure \ref{fig:tradvsseg}), it is represented by ($\beta$ seconds) equal to 100\%.  In segment-by-segment processing scenario with the hyper-parameters (Segment, Step)=(1.75s, 0.75s), the time of processing is 43\% of $\beta$. This means that after fully receiving the speech signal, we wait 2.3 times less with the segment-by-segment processing scenario than the full signal processing scenario.

\section{Conclusions}

In this paper, we presented a speech-to-intent model for low-power devices. The proposed model has a global max-pooling layer that allows not only processing no fixed-length speech signals. But also, it allows processing any speech signal without the need to have it entirely at the moment of processing. The proposed processing scenario is done segment-by-segment, which means that the processing of one segment is done while we are receiving the upcoming segment. This not only reduces the response time but also improves the performances.

\newpage

\bibliographystyle{IEEEtran}


\section{Introduction}
For all $x\in \mathbb{R}$, we define $\lfloor x\rfloor$ as the integer part of $x$, and $\{x\}$ as the fractional part of $x$. For every non-integral $\alpha >1 $, the sequence $(\lfloor n^\alpha \rfloor )_{n=1}^\infty$ is called the \textit{Piatetski-Shapiro sequence with exponent} $\alpha$, and let $\PS(\alpha)$ be the set of all those terms. For all $X\subseteq \mathbb{N}$, and for all polynomials $f(x_1,\ldots, x_n)$ with real coefficients, we say that an equation $f(x_1,\ldots, x_n)=0$ is solvable in $X$ if the equation has infinitely many solutions $(x_1,\ldots, x_n )\in X^n$ with $\#\{x_1,\ldots ,x_n\}=n$. In this article, we discuss the solvability in $\PS(\alpha)$ of the equation
\begin{equation}\label{Equation-main1}
y=ax+b
\end{equation}
for fixed $a,b\in \mathbb{R}$ with $a\notin\{0,1\}$. Glasscock asserted that if equation \eqref{Equation-main1} is solvable in $\mathbb{N}$, then for Lebesgue almost every $\alpha>1$, it is solvable or not in $\PS(\alpha)$, according to $\alpha<2$ or $\alpha>2$  \cite{Glasscock17, Glasscock20}. In addition, as a corollary, he showed that for Lebesgue almost every $1<\alpha<2$, there are infinitely many $(k,\ell,m)\in \mathbb{N}^3$ such that
 \begin{equation}\label{Sequence-klm}
 k,\ \ell,\ m,\ k+\ell,\ \ell+m,\ m+k,\ k+\ell+m
\end{equation}
 are in $\PS(\alpha)$ \cite[Corollary~10]{Glasscock17}. It is a long-standing open problem whether there exists $(k,\ell,m)\in \mathbb{N}^3$ such that all terms of \eqref{Sequence-klm} are in $\PS(2)$ which is the set of all squares.

The goal of this article is to put forward the following theorem which is an improvement on Glasscock's result in the case when $0\leq b<a$. Here for all $F\subseteq \mathbb{R}$, we let $\Haus F$ denote the Hausdorff dimension of $F$. We will give this definition in Section~\ref{Section-Preparations}.

\begin{theorem}\label{Theorem-main1}
Let $a,b\in \mathbb{R}$, with $a \neq 1$ and $0\leq b<a$. Assume that the equation $y=ax+b$ is solvable in $\mathbb{N}$. Then for all $1<\alpha <2$, the equation $y=ax+b$ is solvable in $\PS(\alpha)$. Moreover, for all $s,t\in \mathbb{R}$ with $2< s<t$, we have
\[
\dim_{\mathrm{H}}\{\alpha \in (s,t) \colon \text{$y=ax+b$ is solvable in $\PS(\alpha)$} \}=2/s.
\]
\end{theorem}
We avail of two main improvements when $0\leq b<a$. Firstly, in the case when $1<\alpha<2$, we arrive at the same conclusion as Glasscock's result even if we replace ``for Lebesgue almost every'' with ``for all''.  Secondly, in the case when $\alpha>2$, his result is equivalent to stating that the set $\{\alpha \in (s,t) \colon \text{$y=ax+b$ is solvable in $\PS(\alpha)$} \}$ and has Lebesgue measure $0$ for all $2< s<t$. However, from Theorem~\ref{Theorem-main1}, we find that the set has a Hausdorff dimension of exactly $2/s$. Hence we can discern more details concerning the geometric structure of the set. We will show Theorem~\ref{Theorem-main1} in Section~\ref{Section-Proof_of_Theorem}.

From the first improvement, we obtain the following:
\begin{corollary}\label{Corollary-main2}
For all $1<\alpha<2$, there are infinitely many $(k,\ell,m)\in \mathbb{N}^3$ such that all of $k$, $\ell$, $m$, $k+\ell$, $\ell+m$, $m+k$, and $k+\ell+m$ are in $\PS(\alpha)$.
\end{corollary}
  In the proof  of Corollary~1 in \cite{Glasscock17}, Glasscock applies the result given by Frantzikinakis and Wierdl \cite[Proposition~5.1]{FrantzikinakisWierdl}, and shows that if $y=2x$ is solvable in $\PS(\alpha)$ for fixed $1<\alpha<2$, then there are infinitely many $(k,m,\ell)\in \PS(\alpha)^3$ such that all terms of \eqref{Sequence-klm} are in $\PS(\alpha)$. By this proof, we obtain Corollary~\ref{Corollary-main2} by Theorem~\ref{Theorem-main1}.

We next discuss the solvability in $\PS(\alpha)$ of the equation
\begin{equation}\label{Equation-main2}
ax+by=cz
\end{equation}
for fixed $a,b,c\in \mathbb{N}$. As a corollary of Theorem~\ref{Theorem-main1}, the following holds:
\begin{corollary}\label{Corollary-ax+by=cz}
Let $a,b,c\in \mathbb{N}$ with $\gcd(a,c)|b$ and $a>b$. Then, for all $1<\alpha<2$, the equation $ax+by=cz$ is solvable $\PS(\alpha)$. Further, for all $2< s<t$, we have
\begin{equation}\label{Inequality-dimension}
\Haus \{\alpha \in (s,t) \colon \text{$ax+by=cz$ is solvable in $\PS(\alpha)$} \} \geq \frac{2}{s}.
\end{equation}
\end{corollary}
Indeed, from the condition $\gcd(a,c)|b$, the equation $ax+b=cz$ is solvable in $\mathbb{N}$. By dividing both sides by $c$, we have the equation $z=(a/c)x+(b/c)$ whose coefficients $a/c$ and $b/c$ satisfy the conditions in Theorem~\ref{Theorem-main1}. Moreover, if the equation $ax+b=cz$ is solvable in $\PS(\alpha)$, then by letting $y=1=\lfloor 1^\alpha \rfloor$, we see that the equation $ax+by=cz$ is solvable in $\PS(\alpha)$. Therefore we conclude Corollary~\ref{Corollary-ax+by=cz} from Theorem~\ref{Theorem-main1}.

 In \cite{MatsusakaSaito}, it is proved that for all $a,b,c\in \mathbb{N}$ and $s,t\in \mathbb{R}$ with $2<s<t$, the left-hand side of \eqref{Inequality-dimension} is greater than or equal to
\begin{align*}
\begin{cases}
\displaystyle  \left(s + \frac{s^3}{(2+\{s\}-2^{1-\lfloor s\rfloor} )(2-\{s\}) } \right)^{-1}  & \text{if $a=b=c$}\\[10pt]
\displaystyle 2\left(s+\frac{s^3}{(2+\{s\}-2^{1-\lfloor s\rfloor} )(2-\{s\}) } \right)^{-1} & \text{otherwise}.
\end{cases}
\end{align*}
The lower bounds \eqref{Inequality-dimension} in Corollary~\ref{Inequality-dimension} are better than the above for all $2<s<t$. In particular, we find that the left-hand side of \eqref{Inequality-dimension} goes to $1$ as $s\rightarrow 2+0$ from Corollary~\ref{Inequality-dimension} if $a,b,c$ are restricted.

\begin{notation}
Let $\mathbb{N}$ be the set of all positive integers, $\mathbb{Z}$ be the set of all integers, $\mathbb{Q}$ be the set of all rational numbers, and $\mathbb{R}$ be the set of all real numbers. For all $x\in \mathbb{R}$, let $\lceil x \rceil$ denote the minimum integer $n$ such that $x\leq n$. For all $a,b\in\mathbb{Z}$, we say $a|b$ if $a$ is a divisor of $b$, and let $\gcd(a,b)$ denote the greatest common divisor of $a$ and $b$.  For all sets $X$, let $\# X$ denote the cardinality of $X$. For all sets $X$ and $\Lambda$, let $X^\Lambda$ denote the set of all sequences $(x_\lambda)_{\lambda \in \Lambda}$ composed of $x_\lambda\in X$ for all $\lambda\in \Lambda$.  Define $\mathrm{e}(x)$ by $e^{2\pi \sqrt{-1}x} $ for all $x\in \mathbb{R}$.
\end{notation}

\section{Preparations}\label{Section-Preparations}

A sequence $(x_n)_{n=1}^\infty\in \mathbb{R}^\mathbb{N}$ is called \textit{uniformly distributed modulo 1} if for every $0\leq a<b\leq 1$, we have
\begin{equation}\label{Equation-udm1}
\lim_{N \rightarrow \infty} \frac{\#\left\{ n\in \mathbb{N}\cap[1,N] \colon \{x_n\} \in [a,b) \right\}}{N}=b-a.
\end{equation}
For further details on uniform distribution theory, see the book written by Kuipers and Niederreiter \cite{KuipersNiederreiter}. It is useful to calculate the decay of higher-order derivatives of $f(x)$ in order to verify that a sequence $(f(n))_{n\in \mathbb{N}}$ is uniformly distributed modulo $1$. For example, by \cite[Theorem~3.5]{KuipersNiederreiter}, let $k$ be a positive integer, and let $f(x)$ be a function defined for $x \geq  1$, which is $k$ times differentiable for $x \geq  x_0$. If $f^{(k)}(x)$ tends monotonically to $0$ as $x\rightarrow \infty$ and if $\lim_{x\rightarrow \infty} x| f^{(k)} (x) |= \infty$, then the sequence $(f (n))_{n\in \mathbb{N}}$ is uniformly distributed modulo $1$. By this theorem, we have

\begin{example}\label{Example-udm1}For all $A\in \mathbb{R}\setminus \{0\}$ and non-integral $\alpha>1$, the sequence $(An^\alpha)_{n=1}^\infty$ is uniformly distributed modulo $1$.
\end{example}

\begin{proof}
Let $f(x)=Ax^{\alpha}$, and $k=\lfloor \alpha \rfloor+1$. Then $f^{(k)}(x)$ tends monotonically to $0$. In addition, there exists $C=C(\alpha)>0$ such that $|xf^{(k)}(x)|\geq C x^{\alpha-\lfloor \alpha \rfloor}\rightarrow \infty$ as $x\rightarrow\infty$. Therefore the sequence $(f(n))_{n=1}^\infty$ is uniformly distributed modulo $1$.
\end{proof}

To show Theorem~\ref{Theorem-main1}, it is not sufficient to only consider the uniform distribution of sequences. We also need to analyze the convergence speed of \eqref{Equation-udm1}. Let  $(x_n)_{ n=1}^ N$ be a sequence composed of $x_n\in \mathbb{R}$ for all $1\leq n\leq N$. We define the \textit{discrepancy} of $(x_n)_{n=1}^N$ by
\[
\mathcal{D}((x_n)_{n=1}^N )=\sup_{0\leq a<b\leq 1} \left| \frac{\#\left\{ n\in \mathbb{N}\cap[1,N] \colon \{x_n\} \in [a,b) \right\}}{N}-  (b-a)  \right|.
\]
We can find upper bounds of the discrepancy from evaluating exponential sums by the following inequality: for all $m\in \mathbb{N}$
\begin{equation}\label{Inequality-Erdos_Turan}
\mathcal{D}((x_n)_{n=1}^N)\leq    \frac{6}{m+1}
+\frac{2}{\pi}\sum_{h=1}^m \left(\frac{1}{h}-\frac{1}{m+1}\right) \left|\frac{1}{N} \sum_{n=1}^N \mathrm{e}( hx_n) \right|.
\end{equation}
This is called the Erd\H{o}s-Tur\'an inequality, a proof of which can be found in \cite[Theorem~2.5 in Chapter~2]{KuipersNiederreiter}. If we can write $hx_n=f(n)$ in \eqref{Inequality-Erdos_Turan} for some smooth real function $f(x)$, then we can evaluate the right-hand side of \eqref{Inequality-Erdos_Turan} by the following lemma.
\begin{lemma}[van der Corput's $k$-th derivative test]\label{Lemma-van_der_Corput}
Let $f(x)$ be real and have continuous derivatives up to the $k$-th order, where $k\geq 4$. Let $\lambda_k \leq f^{(k)} (x) \leq h \lambda_k$ $($or the same as for $-f^{(k)}(x))$. Let $b-a\geq 1$. Then there exists $C(h,k)>0$ such that
\[
\left|\sum_{a<n\leq b} \mathrm{e} (f(n)) \right| \leq C(h,k) \left((b-a)\lambda_k^{1/(2^k-2)}+(b-a)^{1-2^{2-k}}\lambda_k^{-1/(2^k-2)} \right).
\]
\end{lemma}
\begin{proof}
See the book written by Titchmarsh \cite[Theorem~5.13]{Titchmarsh}.
\end{proof}

We next introduce the Hausdorff dimension. For every $U\subseteq \mathbb{R}$, state the diameter of $U$ as $\diam(U)=\sup_{x,y\in U}|x-y|$. Fix $\delta>0$. For all $F\subseteq \mathbb{R}$ and $s\in (0,1]$, we define
\[
\cH_{\delta}^s (F)=\inf \left\{\sum_{j=1}^\infty \diam(U_j)^s\colon F\subseteq \bigcup_{j=1}^\infty U_j,\  \diam(U_j)\leq \delta  \text{ for all }j\in \mathbb{N}  \right\},
\]
and $\cH^s(F)=\lim_{\delta\rightarrow +0} \cH_\delta^s(F)$ is called the $s$-\textit{dimensional Hausdorff measure} of $F$. Further, we define the \textit{Hausdorff dimension} of $F$ by
\[
\Haus F=\inf \{s\in (0,1] \colon \mathcal{H}^s(F)=0 \}.
\]
From the definition, the following basic properties hold:
\begin{itemize}
\item (monotonicity) for all $F\subseteq E \subseteq \mathbb{R}$, $\Haus F \leq \Haus E$;
\item (bi-Lipschitz invariance) let $f:F\to \mathbb{R}$ be a bi-Lipschitz map, that is, there exist $C_1,C_2>0$ such that $C_1|x-y|\leq |f(x)-f(y)|\leq C_2|x-y|$ for all $x,y\in F$. Then $\Haus F=\Haus f(F)$.
\end{itemize}
Comprehensive details concerning fractal dimensions can be found in the book by Falconer \cite{Falconer}. By the second property and the mean value theorem, we immediately obtain
\begin{lemma}\label{Lemma-C1_invariance}
Let $U\subseteq \mathbb{R}$ be an open set and let $V\subseteq U$ be a compact set. Let $f:U\to \mathbb{R}$ be a continuously differentiable function satisfying $|f'(x)|>0$ for all $x\in V$. Then for all $F\subseteq V$, $\dim_{\mathrm{H}} f(F)=\dim_{\mathrm{H}} F$.
\end{lemma}

For all $\gamma\geq 2$ and sets $X\subseteq  \mathbb{R}$, define
\begin{align*}
\mathcal{A}(X,\gamma)=\{x\in X \colon &\text{there are infinitely many $(p,q) \in \mathbb{Z}\times \mathbb{N} $}\\
 &\text{such that } \left|x-\frac{p}{q} \right|\leq \frac{1}{q^\gamma}\ \}.
\end{align*}
In particular, if $X=\mathbb{R}$ and $\gamma=2$, we know that $\mathcal{A}(\mathbb{R},2)=\mathbb{R}$. This result is called Dirichlet's approximation theorem. In addition, in the case when $\gamma>2$ and $X=[0,1]$, the following result is known:

\begin{theorem}[Jarn\'{i}k's theorem]\label{Theorem-Jarnik}
For all $\gamma> 2$, we have $\dim_{\mathrm{H}} \mathcal{A}([0,1],\gamma)=2/\gamma.$
\end{theorem}
\begin{proof}
See \cite[Theorem~10.3]{Falconer}.
\end{proof}
 In Section~\ref{Section-Propositions}, we will use rational approximations of $a^{1/\alpha}$, and we find infinitely many solutions $(x,y)\in \PS(\alpha)^2$ of the equation $y=ax+b$.

\section{Lemmas}
The goal of this section is to show a series of lemmas so as to evaluate discrepancies and calculate the Hausdorff dimension.

We write $O(1)$ for a bounded quantity. If this bound depends only on some parameters $a_1,\ldots, a_n$, then for instance we write $O_{a_1,a_2,\ldots, a_n}(1)$. As is customary, we often abbreviate $O(1)X$ and $O_{a_1,\ldots, a_n}(1)X$ to $O(X)$ and $O_{a_1,\ldots, a_n}(X)$ respectively for a non-negative quantity $X$. We also state $f(X) \ll g(X)$ and $f(X) \ll_{a_1,\ldots, a_n} g(X)$  as $f(X)=O(g(X))$ and $f(X)=O_{a_1,\ldots, a_n}(g(X))$ respectively, where $g(X)$ is non-negative.

\begin{lemma}\label{Lemma-discrepancy}
 For every non-integral $\alpha>1$, integer $k\geq 4$, and real numbers $\eta>0 $ and $V\geq 1$, if $\eta V^{\alpha-k}<1$ holds, then we have
\[
\mathcal{D}((\eta n^\alpha)_{V<n\leq 2V} )\ll_{\alpha,k} (\eta V^{\alpha-k})^{1/(2^k-1)} +\eta^{-1/(2^k-2)}V^{(k-\alpha)/(2^k-2) -2^{2-k}}.
\]
\end{lemma}

\begin{proof} Fix any $\alpha$, $k$, $\eta$, $V$ given in Lemma~\ref{Lemma-discrepancy} which satisfy $\eta V^{\alpha-k}<1$.  Let $f_h(x)=h\eta x^\alpha$ for every $h\in \mathbb{N}$ and $x>0$. Then we have
$
h\eta V^{\alpha-k}\ll_{\alpha,k} f^{(k)}(x) \ll_{\alpha,k}h\eta V^{\alpha-k}
$
for all $V<x\leq 2V$. Therefore, the following holds from the Erd\H{o}s-Tur\'an inequality \eqref{Inequality-Erdos_Turan} and Lemma~\ref{Lemma-van_der_Corput} with $f=f_h$: for all $m\in \mathbb{N}$,
\begin{align*}
\mathcal{D}((\eta n^\alpha )_{V<n\leq 2V})&\ll m^{-1} +\sum_{h=1}^{m} \frac{1}{h} \left| \frac{1}{V} \sum_{V<x\leq 2V} \mathrm{e}(h\eta x^\alpha ) \right|\\
&\ll_{\alpha, k} m^{-1} +\sum_{h=1}^m \frac{1}{h} \left|\left(h\eta V^{\alpha-k}\right)^{1/(2^k-2)}+V^{-2^{2-k}} \left(h \eta V^{\alpha-k}\right)^{-1/(2^k-2)}\right|\\
&\ll_{\alpha,k} m^{-1} +(m\eta V^{\alpha-k})^{1/(2^k-2)} +\eta^{-1/(2^k-2)}V^{(k-\alpha)/(2^k-2) -2^{2-k}}.
\end{align*}
Hence by substituting $m=\lceil (\eta^{-1} V^{k-\alpha})^{1/(2^k-1)} \rceil $, we get the lemma.
\end{proof}

\begin{lemma}\label{Lemma-discrepancy_of_B}
Let $\alpha>1$ be a non-integral real number, $\gamma\in \mathbb{R}$ with $0<\gamma-\alpha<1$, and let $A>0$ be a real number. Then there exist $Q_0=Q_0(\alpha,\gamma,A)>0$, $\xi_0=\xi_0(\alpha,\gamma)>0$, and $\psi=\psi(\alpha,\gamma)<0$ such that for all $Q\geq Q_0$ and $0<\xi\leq \xi_0$, we have
\[
\mathcal{D}((A Q^\alpha x^\alpha )_{V<x\leq 2V})\ll_{\alpha,\gamma,A} Q^{\psi}
\]
where $V=Q^{(\gamma-\alpha-\xi)/\alpha}$.
\end{lemma}

\begin{proof}Take an integer $k\geq 4$ such that
\begin{equation}\label{Inequality-alpha_k}
\frac{\gamma (k-3)} { \gamma+k-3}< \alpha <\frac{\gamma k} { k+\gamma}.
\end{equation}
Note that there exists such an integer $k$. Let $g(k )=\gamma (k-3)/(\gamma+k-3)$. Then $g(k)$ is strictly increasing for all $k\geq 4$. Since $g(4)=\gamma/(\gamma+1)$ and $\lim_{k\rightarrow \infty } g(k)=\gamma$, we have
\[
\alpha\in (1,\gamma) \subseteq \bigcup_{k=4}^\infty (g(k), g(k+3)).
\]
Therefore, there exists an integer $k\geq 4$ satisfying \eqref{Inequality-alpha_k}. Let us fix such an integer as $k=k(\alpha,\gamma)\geq 4$. By the condition $V= Q^{(\gamma-\alpha-\xi)/\alpha }$, we observe that
\[
A Q^\alpha V^{\alpha-k}=AQ^{\psi_1}
\]
where $\psi_1:=\alpha +(\gamma-\alpha-\xi)(\alpha-k)/\alpha$. Then the inequality $\alpha<\gamma k/(k+\gamma)$ yields that
\[
\psi_1 <((\gamma+k)\alpha -\gamma k)/\alpha<0.
\]
Therefore, if $Q_0$ is sufficiently large and $Q\geq Q_0$, then
$A Q^\alpha V^{\alpha-k}<1$. Thus we may apply Lemma~\ref{Lemma-discrepancy} with $\eta=A Q^\alpha$ and $V=Q^{(\gamma-\alpha-\xi)/\alpha }$ to obtain
\begin{align*}
\mathcal{D}((A Q^\alpha x^\alpha )_{V<x\leq 2V})&\ll_{\alpha,\gamma,A} (Q^{\alpha}V^{\alpha-k})^{1/(2k-1)}+Q^{-\alpha/(2^k-2)}V^{(k-\alpha)/(2^k-2) -2^{2-k}}  \\
&= Q^{\psi_1/(2^k-1)} +Q^{\psi_2}  \label{Inequality-discrepancy_on_q_n},
\end{align*}
where
\[
\psi_2:=-\frac{\alpha}{2^k-2}+\frac{\gamma-\alpha-\xi}{\alpha} \left(\frac{k-\alpha}{2^k-2}-\frac{4}{2^k}  \right).
\]
Then we have
\begin{align*}
\psi_2&=\frac{-\alpha^22^k +(\gamma-\alpha)(k-\alpha)2^k -4(\gamma-\alpha)(2^k-2) }{2^k(2^k-2)\alpha}+O_{\alpha,\gamma}(\xi)\\
&=\frac{(\gamma k-(\gamma+k-4)\alpha-4\gamma )2^k +8(\gamma-\alpha) }{2^k(2^k-2)\alpha}+O_{\alpha,\gamma}(\xi).
\end{align*}
 Therefore the inequalities $\alpha> \gamma(k-3)/(\gamma+k-3)$ and $\gamma-\alpha<1$ imply that for sufficiently small $\xi>0$,
\begin{align*}
\psi_2&<\frac{-2^{k}\cdot \gamma^2 /(\gamma+k-3) +8  }{2^k(2^k-2)\alpha}+O_{\alpha, \gamma}(\xi)\\
&<\frac{-2^{k}/(k-2) +8  }{2^{k+1}(2^k-2)\alpha}\leq 0.
\end{align*}
Therefore, there exists $\psi=\psi(\alpha,k)<0$ so that  $\mathcal{D}((A Q^\alpha x^\alpha )_{V<x\leq 2V})\ll_{\alpha, \gamma, A} Q^{\psi}$.
\end{proof}
We next present lemmas on the Hausdorff dimension.
\begin{lemma}\label{Lemma-GenJarnik}
For all non-empty and bounded open intervals $J\subseteq \mathbb{R}$, we have
 \[
 \dim_{\mathrm{H}} \mathcal{A}(J,\gamma)=2/\gamma.
 \]
\end{lemma}

\begin{proof}There exist $m\in \mathbb{Z}$ and $h\in \mathbb{N}$ such that $J\subseteq [m,m+h]$. When $x\in \mathcal{A} (J,\gamma)$, there are infinitely many $(p,q) \in \mathbb{Z}\times \mathbb{N}$ such that $\left|x-p/q \right|\leq q^{-\gamma}$. Then for all $\epsilon>0$, and for infinitely many $(p,q)\in \mathbb{Z}\times \mathbb{N}$,
\[
\left| \frac{x-m}{h} - \frac{p-mq }{qh} \right|\leq \frac{1}{hq^{\gamma}}\leq \frac{1}{q^{\gamma-\epsilon}}.
\]
Thus $f(\mathcal{A}(J,\gamma)) \subseteq \mathcal{A}([0,1],\gamma-\epsilon)$ where $f(x)=(x-h)/m$. By the bi-Lipschitz invariance and monotonicity of the Hausdorff dimension and Theorem~\ref{Theorem-Jarnik}, we obtain
\[
\Haus \mathcal{A}(J,\gamma) = \Haus  f(\mathcal{A}(J,\gamma)) \leq \dim_{\mathrm{H}} \mathcal{A}([0,1],\gamma-\epsilon)=\frac{2}{\gamma-\epsilon}.
\]
By taking $\epsilon\rightarrow +0$, $\Haus \mathcal{A}(J,\gamma) \leq 2/\gamma$.

We next show that $\Haus \mathcal{A}(J,\gamma) \geq 2/\gamma$. There exist $\ell \in \mathbb{Z}$ and $M\in \mathbb{N}$ such that $J\supseteq [\ell/M, (\ell+1)/M]$. Take such $\ell$ and $M$.  Then for all $x\in \mathcal{A} ([0,1],\gamma+\epsilon)$, there are infinitely many $(p,q) \in \mathbb{Z}\times \mathbb{N}$ such that $\left|x-p/q \right|\leq q^{-\gamma-\epsilon}$. Then for all $\epsilon>0$, and for infinitely many $(p,q)\in \mathbb{Z}\times \mathbb{N}$, we have
\[
\left|\frac{\ell+x}{M} -\frac{\ell q+p}{qM} \right|\leq \frac{1}{M}\frac{1}{q^{\gamma+\epsilon}} <\frac{1}{q^\gamma}.
\]
This inequality and $(\ell+x)/M\in J$ imply that $g(\mathcal{A}([0,1],\gamma+\epsilon)) \subseteq \mathcal{A} (J,\gamma)$ where $g(x)=(x+\ell)/M$.  By the monotonicity and bi-Lipschitz invariance of the Hausdorff dimension and Theorem~\ref{Theorem-Jarnik}, we have $\Haus \mathcal{A} (J,\gamma ) \geq 2/(\gamma+\epsilon)$ for all $\epsilon>0$. Hence by taking $\epsilon\rightarrow +0$, we conclude $\Haus \mathcal{A} (J,\gamma ) \geq 2/\gamma$.
\end{proof}

\begin{lemma}\label{Lemma-application_Jarnik}
Let $I\subseteq (1,\infty)$ be a non-empty and bounded open interval, and let $\gamma> 2$ and $a>0$ be real numbers with $a\neq 1$. Define
\begin{align*}
\mathcal{E}(I,\gamma;a)=\{\alpha\in I \colon &\text{there are infinitely many $(p,q)\in \mathbb{Z}\times \mathbb{N}$} \\
&\text{ such that } \left|a^{1/\alpha}-\frac{p}{q} \right|\leq \frac{1}{q^{\gamma}}\}.
\end{align*}
Then we have
$
\Haus \mathcal{E}(I,\gamma;a)=2/\gamma.
$
\end{lemma}

\begin{proof}
For all $u>0$, let $f(u)=a^{1/u}$. Fix a compact set $V\subseteq \mathbb{R}$ with $I \subseteq V$. Clearly, $f$ is continuously differentiable and $|f'(u)|>0$ for all $u\in V$.  By the definitions, $f(\mathcal{E}(I,\gamma;a))=\mathcal{A}(f(I),\gamma)$. Since $f(I)$ is also a bounded open interval, Lemma~\ref{Lemma-C1_invariance} and Lemma~\ref{Lemma-GenJarnik} imply that
\[
\dim_{\mathrm{H}} \mathcal{E}(I,\gamma; a)=\dim_{\mathrm{H}} f(\mathcal{E}(I,\gamma;a))=\dim_{\mathrm{H}} \mathcal{A}(f(I),\gamma)=\frac{2}{\gamma}.
\]
\end{proof}

\section{Key Propositions}\label{Section-Propositions}
In this section, we show two key propositions by applying rational approximations.
\begin{proposition}\label{Proposition-upper}Let $a,b\in \mathbb{R}$ with $a\neq 1$ and $a>0$. For all $1\leq \beta <\gamma$, we have
\[
\{\alpha\in (\beta,\gamma) \colon y=ax+b \text{ is solvable in } \mathrm{PS}(\alpha) \}
\subseteq \mathcal{E}((\beta,\gamma),\beta; a).
\]
\end{proposition}

\begin{proof}Fix $\beta,\gamma\in \mathbb{R}$ with $1\leq \beta <\gamma$. Take any $\alpha\in (\beta,\gamma)$ such that the equation $y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$. Then there are infinitely many $(p,q)\in \mathbb{N}\times \mathbb{N}$ such that $\lfloor p^\alpha \rfloor  = a\lfloor q^\alpha \rfloor+ b$, which implies that
\[
\frac{p}{q}=\left(a+\frac{b+\{p^\alpha\}-a\{q^\alpha\}}{ q^\alpha}\right)^{1/\alpha} =a^{1/\alpha} + O_{a,b}(q^{-\alpha}).
\]
Hence, there exist $C=C(a,b)>0$ such that for infinitely many $(p,q)\in \mathbb{N}^2$,
\[
\left|a^{1/\alpha} - \frac{p}{q}\right| \leq \frac{C}{q^{\alpha}} \leq \frac{1}{q^{\beta}}.
\]
This yields that $\alpha \in \mathcal{E}((\beta,\gamma),\beta;a)$.
\end{proof}

\begin{proposition}\label{Proposition-lower}Let $a,b\in \mathbb{R}$ with $a\neq 1$ and $0\leq b<a$. Suppose that $y=ax+b$ is solvable in $\mathbb{N}$. Then for all $1\leq \beta <\gamma$ with $\lfloor \beta \rfloor < \beta<\gamma < \lfloor \beta \rfloor+1$, we have
\[
 \mathcal{E}((\beta,\gamma),\gamma;a)\subseteq \{\alpha\in (\beta,\gamma) \colon y=ax+b \text{ is solvable in } \mathrm{PS}(\alpha) \}.
\]
\end{proposition}

\begin{proof}
Since the equation $y=ax+b$ is solvable in $\mathbb{N}$, there exist distinct solutions $(x_1,y_1), (x_2,y_2)\in \mathbb{N}^2$ of the equation. Then since $y_2-y_1=a(x_2-x_1)$ and $(x_1,y_1)\neq (x_2,y_2)$, we have $a\in \mathbb{Q}$. In addition, $b\in \mathbb{Q}$ holds from $b=y_1-ax_1$. Thus we may let $a=a_1/a_2$, $b=b_1/b_2$, ($a_1,a_2,b_2\in\mathbb{N}$, $b_1\in \mathbb{N}\cup \{0\}$).  By letting $c=a_2b_2$, $d=a_1b_2$, $e=a_2b_1$, a pair $(x,y)\in \mathbb{N}^2$ satisfies the equation $cy-dx=e$ if and only if $(x,y)$ satisfies the equation $y=ax+b$. Therefore we now discuss the solvability in $\PS(\alpha)$ of the equation $cy-dx=e$. Take any $\alpha\in \mathcal{E}((\beta,\gamma),\gamma;a)=\mathcal{E}((\beta,\gamma),\gamma;d/c)$. Let us show that the equation $cy-dx=e$ is solvable in $\PS(\alpha)$.

By the definition, there is a sequence $((p_n,q_n))_{n=1}^\infty \in (\mathbb{Z}\times \mathbb{N})^\mathbb{N}$ such that for all $n\in \mathbb{N}$,
\[
\left|(d/c)^{1/\alpha}-p_n/q_n\right|<{q_n^{-\gamma}},
\]
where $q_1<q_2<\cdots$. Since $(d/c)^{1/\alpha}>0$ and $d/c\neq 1$, there exists $n_0=n_0(d,c)\in \mathbb{N}$ such that for all $n\geq n_0$, we obtain $p_n>0$ and $p_n\neq q_n$.

From the solvability in $\mathbb{N}$, there exist $u,v\in \mathbb{N}$ such that $cu-dv=e$. By the division algorithm, there exist $r,v'\in \mathbb{Z}$ such that $v=cr+v'$, $0\leq v'<c$. Hence by replacing $u-dr$ and $v'$ with $u$ and $v$ respectively, we obtain
\begin{equation}\label{Equation-cde}
cu-dv=e,\quad 0\leq v<c.
\end{equation}

Take sufficiently small parameters $\xi=\xi(\alpha,\gamma)>0$ and $\epsilon\in (0,1-e/d)$, and take a sufficiently large parameter $n_1=n_1(\alpha,\gamma,c,d,\epsilon)\in \mathbb{N}$. Note that we verify the existence of $\epsilon$ since $e<d$. Take $n \in \mathbb{N}$ with $n\geq n_1$. Let $V_n= q_n^{(\gamma-\alpha-\xi)/\alpha } $. Define
\begin{gather*}
I=\left[ \frac{v}{c},\ \frac{v}{c}+\frac{1}{c} \right) \cap \left[\frac{u}{d}+\frac{\epsilon}{d},\ \frac{u}{d}+\frac{1}{d}-\frac{\epsilon}{d} \right),\ B_n=\left\{x\in \mathbb{N} \colon \left\{ \frac{(q_nx)^\alpha}{c}  \right\}\in I  \right\}.
\end{gather*}
If $n_1$ is large enough and $\xi$ is small enough, then by the definition of the discrepancy and Lemma~\ref{Lemma-discrepancy_of_B} with $V=V_n$, $Q=q_n$, $A=1/c$, there exists $\psi=\psi(\alpha,\gamma)<0$ such that
\[
\#(B_n\cap (V_n,2V_n])/V_n = \mathrm{diam}(I\cap [0,1) ) +O_{\alpha,\gamma,c}(q_{n}^{\psi}).
\]
Here we show $\mathrm{diam}(I\cap [0,1) )>0$. Indeed, by \eqref{Equation-cde}, we obtain
\[
\frac{u}{d} +\frac{\epsilon}{d}=\frac{v}{c}+\frac{e}{cd}+\frac{\epsilon}{d}> \frac{v}{c}\geq 0.
\]
Moreover, the inequality $\epsilon<1-e/d$ yields that
\[
\frac{u}{d}+\frac{\epsilon}{d} = \frac{v}{c}+\frac{1}{c} + \frac{e-d}{cd}+\frac{\epsilon}{c} < \frac{v}{c}+\frac{1}{c}\leq 1.
\]
Hence $\mathrm{diam}(I\cap [0,1) )>0$. Therefore there exists a large enough $n_1=n_1(\alpha,\gamma,c, d,e,\epsilon)\in \mathbb{N}$ such that for all $n\geq n_1$, we get $\#(B_n\cap (V_n,2V_n])/V_n \geq  \mathrm{diam}(I\cap [0,1) )/2$,
which means that $B_n\cap (V_n,2V_n]$ is non-empty.

Hence we may take $x\in B_n\cap (V_n,2V_n]$ where $n\geq n_1$. Then
\[
 (q_nx)^\alpha= c  \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor +c \left\{ \frac{(q_nx)^\alpha}{c} \right\}
 = \left(c  \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+v\right) +\left(c \left\{ \frac{(q_nx)^\alpha}{c} \right\}-v\right).
\]
The first term on the most right-hand side is an integer, and the second is in $[0,1)$ from the definition of $B_n$. Therefore we have
\[
\lfloor (q_nx)^\alpha \rfloor=   c  \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+v.
\]
Let $\theta=p_n/q_n-(d/c)^{1/\alpha}$. By the mean value theorem, there exist $C=C(c,d,\alpha)>0$ and $\theta'\in \mathbb{R}$ with $|\theta'|\leq |\theta|$ such that
$
\left(p_n/q_n\right)^\alpha=( \left(d/c\right)^{1/\alpha} +\theta )^\alpha=d/c+C\theta'.
$
Therefore,
\begin{align*}
(p_n x)^\alpha&=\left(\frac{p_n}{q_n}\right)^\alpha (q_n x)^\alpha =d \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+ d \left\{ \frac{(q_nx)^\alpha}{c} \right\}+C\theta' (q_nx)^\alpha\\
&=\left(d \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+u\right) + \left(d \left\{ \frac{(q_nx)^\alpha}{c} \right\}-u\right)+C\theta' (q_nx)^\alpha.
\end{align*}
The first term on the most right-hand side is an integer, and the second term is in $[\epsilon,1-\epsilon)$ by $x\in B_n$. Further, if necessary, we replace $n_1$ with a larger one, and by $x\in (V_n,2V_n]$, the third term is evaluated by
\[
|C\theta' (q_nx)^\alpha| \leq 2^\alpha C\frac{q_n^\alpha q_n^{\gamma-\alpha-\xi} }{ q_n^\gamma } \leq 2^\alpha Cq_n^{-\xi}\leq 2^\alpha Cq_{n_1}^{-\xi}< \epsilon.
\]
 Hence we obtain
\[
\lfloor (p_nx)^\alpha \rfloor =d \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+u.
\]
By the above discussion, if $x\in B_n\cap(V_n,2V_n]$ and $n\geq n_1$, then
\[
c\lfloor (p_nx)^\alpha \rfloor-d\lfloor(q_nx)^\alpha \rfloor= cd  \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor+cu
-dc  \left\lfloor \frac{(q_nx)^\alpha}{c} \right\rfloor-dv=cu-dv=e,
\]
which means that $(\lfloor (q_nx)^\alpha \rfloor, \lfloor (p_nx)^\alpha \rfloor)\in \mathbb{N}^2$ is a solution of the equation $cy-dx=e$. Therefore the equation $cy-dx=e$ is solvable in $\mathrm{PS}(\alpha)$ since $B_n\cap (V_n ,2V_n]$ is non-empty for all $n\geq n_1$.
\end{proof}

\section{Proof of Theorem~\ref{Theorem-main1}}\label{Section-Proof_of_Theorem}
Fix $a,b\in \mathbb{R}$ with $a\neq 1$ and $0\leq b<a$. In the case $\alpha \in (1,2)$, we apply Proposition~\ref{Proposition-lower} with $\beta=1$ and $\gamma=2$. Then
\[
\mathcal{E}((1,2),2;a)\subseteq \{\alpha \in (1,2) \colon \text{$y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$} \}.
\]
By Dirichlet's approximation theorem, $\mathcal{E}((1,2),2;a)=(1,2)$. Therefore the equation $y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$ for all $\alpha\in (1,2) $.

We next discuss the case when $\alpha>2$. Fix $s,t\in \mathbb{R}$ with $2<s<t$. By applying Proposition~\ref{Proposition-upper} with $\beta=s$ and $\gamma=t$, and applying Lemma~\ref{Lemma-application_Jarnik}, we have
\begin{equation}\label{Inequality-upper_bound_for_main1}
\dim_{\mathrm{H}} \{\alpha \in (s,t) \colon \text{$y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$} \}\leq\dim_{\mathrm{H}} \mathcal{E}((s,t),t;a)= \frac{2}{s}.
\end{equation}
Further, let $\delta>0$ be an arbitrarily small parameter. By applying Proposition~\ref{Proposition-lower} with $\beta=s$ and $\gamma=\min\{s+\delta,\lfloor s\rfloor +1, t \}$, and applying Lemma~\ref{Lemma-application_Jarnik}, we obtain
\begin{align*}
\dim_{\mathrm{H}} \{\alpha \in (s,t) \colon \text{$y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$} \} \geq \dim_{\mathrm{H}} \mathcal{E}((s,\gamma),\gamma;a)=  \frac{2}{s+\delta}
\end{align*}
for every small enough $\delta>0$. Therefore we get the theorem by taking $\delta\rightarrow +0$.

\begin{remark} Let $\alpha \in (\beta,\gamma)$ where $\beta$ and $\gamma$ satisfy $1\leq \beta <\gamma$ and $\lfloor \beta \rfloor <\beta <\gamma <\lfloor\beta \rfloor+1$. If $a^{1/\alpha} \in \mathbb{Q}$, then it is clear that for infinitely many $(p,q)\in \mathbb{Z}\times \mathbb{N}$ we have $| a^{1/\alpha}-p/q | \leq q^{-\gamma}$. By Proposition~\ref{Proposition-lower}, the equation $y=ax+b$ is solvable in $\PS(\alpha)$. Therefore, for all $a,b\in \mathbb{R}$ with $a\neq 1$ and $0\leq b<a$, and for all non-integral $\alpha>1$ satisfying $a^{1/\alpha} \in \mathbb{Q}$, the equation $y=ax+b$ is solvable in $\PS(\alpha)$.
\end{remark}

\begin{remark}We apply Proposition~\ref{Proposition-upper} and Lemma~\ref{Lemma-application_Jarnik} to show the inequality \eqref{Inequality-upper_bound_for_main1}. Note that the condition $0\leq b<a$ is not required in Proposition~\ref{Proposition-upper} and Lemma~\ref{Lemma-application_Jarnik}. Hence, for all $a, b\in \mathbb{R}$ with $a\neq 1$ and $a>0$, and for all $s,t\in \mathbb{R}$ with $2< s<t$, we obtain
\[
\dim_{\mathrm{H}} \{\alpha \in (s,t) \colon \text{$y=ax+b$ is solvable in $\mathrm{PS}(\alpha)$} \}\leq \frac{2}{s}.
\]
\end{remark}

\section*{Acknowledgement}
The author was supported by JSPS KAKENHI Grant Number JP19J20878.
\bibliographystyle{amsalpha}