\section*{Plain Language Summary}
``Space weather'' describes the conditions of the plasma surrounding Earth, which can have severe impact on the functionality of spacecraft as well as the health of human space travelers. Space weather and the dynamics of space plasmas in general are closely linked to the structure and topology of the magnetic fields permeating our solar system. By a process called magnetic reconnection, magnetic field lines can rapidly and suddenly break and reconfigure their connectivity, allowing for an explosive release of magnetic energy. This phenomenon is at the origin of explosive events such as solar flares and is the driver of magnetic storms in the Earth's magnetosphere powering the Auroras.

We present new laboratory observations of this near-Earth reconnection process recreated in the Terrestrial Reconnection EXperiment (TREX). The experiment provides detailed measurements of the width of the region where the magnetic field lines break, the electron diffusion region (EDR). Consistent with supercomputer simulations of reconnection, the width of the EDR is measured to be set by the fine spatial scale of the electron orbit motions. As such, the observations provide renewed evidence that the reconnection process is mediated by forces of thermal stress related to the electron motion within the reconnection region.

\section[sec:intro]{Introduction}

Magnetic reconnection \cite{dungey:1953} is the process of changing the topology of magnetic field lines in the presence of a plasma, often permitting an explosive release of magnetic energy. Well-known examples include solar flares \cite{priest:2000} and auroral substorms in the Earth's magnetosphere \cite{vasyliunas:1975}. Although reconnection often governs the global dynamics of plasma systems, the reconnection process occurs in localized electron diffusion regions (EDRs), where the motion of the electron fluid decouples from the magnetic field, breaking the frozen-in law of magnetohydrodynamics. The origin of this process in the collisionless regime, where conventional resistive friction is absent, remains controversial. For example, laminar kinetic models predict that the EDRs are characterized by intense current layers with widths as narrow as the kinetic scales associated with the electron orbit motion \cite{vasyliunas:1975,pritchett:2001}. In other models, the scattering of electrons by electric field fluctuations associated with high-frequency instabilities is proposed to widen the current layers and enhance the anomalous transfer of momentum from the electrons to the ions \cite{papadopoulos:1977,huba:1977,hoshino:1991}.

Significant insight into reconnection physics is provided by fully kinetic numerical models. In 3D configurations it has been argued that turbulence can cause local suppression of the effective conductivity \cite{silin:2005,che:2011,munoz:2017}, but other simulation studies have reported these effects are relatively small in both low-$\beta$ parameter regimes \cite{liu:2013} relevant to solar physics and for higher-$\beta$ regimes with asymmetric layers relevant to the magnetosphere \cite{roytershteyn:2012,hesse:2018,le:2018}. Rather, these 2D and 3D kinetic models typically suggest that fast reconnection can be mediated by electron inertia, and terms in the electron pressure tensor
\cite{speiser:1965,vasyliunas:1975,lyons:1990,horiuchi1994particle,cai1997generalized,kuznetsova1998kinetic}. These effects require the formation of intense electron current channels with widths characterized by either the electron inertial length $d_e=c/\omega_{pe}$ or the electron orbit scale \cite{roytershteyn:2013}.

To observationally address this issue, a primary goal of NASA's Magnetospheric Multiscale (MMS) Mission is to characterize the structures of EDRs for reconnection sites in the Earth's magnetosphere \cite{burch:2016b}. However, the {\sl in situ} observations have not as yet provided conclusive insight to the role of anomalous resistivity. For example, the initial magnetotail observations are consistent with laminar kinetic reconnection \cite{torbert:2018,egedal:2019,genestreti2018,nakamura2018}. Meanwhile, for a magnetopause reconnection layer crossing \cite{burch:2016} evidence for anomalous resistivity was identified near an EDR \cite{torbert:2016}, but a separate analysis concluded the electron dynamics were in agreement with a 2D kinetic model (without anomalous resistivity) \cite{egedal:2018}.

Dedicated laboratory experiments can provide complementary methods to study EDRs. Contrary to spacecraft measurements, laboratory experiments allow the controlled and reproducible study of reconnection layers with well understood upstream conditions and magnetic geometry. Results from the Magnetic Reconnection Experiment (MRX) at Princeton find that the current layer widths are much wider (by approximately a factor of four) compared to the predictions by kinetic models \cite{ji:2008}. This disagreement \cite{dorfman:2008} remains unresolved as it persists even when accounting for collisions \cite{roytershteyn:2010}, and 3D instabilities \cite{roytershteyn:2013}.

In this paper, we report on experimental and numerical investigations of the EDR width using the Terrestrial Reconnection EXperiment (TREX) at the University of Wisconsin-Madison \cite{Forest2015,olson:2016,olson:2021}. While TREX and MRX both have similar normalized system sizes, $\simeq 10 c/\omega_{pi}$ where $\omega_{pi}$ is the ion plasma frequency, TREX is physically larger and operates at lower plasma density and a more collisionless regime (Lundquist number, $S\simeq 10^4$), where anisotropic and non-gyrotropic electron pressure tensor effects can begin to develop around the EDR \cite{le:2015}. Furthermore, the TREX experiment applies a unique jogging method, where the reconnection layer is swept across magnetic sensors, yielding high spatial resolution measurements of the magnetic structures.
To elucidate the experimental findings, fully kinetic 2D and 3D simulations were performed with plasma profiles and reconnection drives that are comparable to the experiment.

\section[sec:trex]{The Terrestrial Reconnection EXperiment (TREX)}

The applied TREX configuration is presented by the engineering schematic in Fig.~\ref{fig:schematic}(a). The vacuum vessel, provided by the Wisconsin Plasma Physics Laboratory (WiPPL) \cite{Forest2015}, is a $3$ meter diameter sphere that uses an array of permanent magnets embedded in the chamber wall to limit the plasma loss area to a very narrow fraction of the total surface area while keeping the bulk of the plasma unmagnetized. The setup includes a set of internal drive coils and an exterior Helmholtz coil that provides a near-uniform axial magnetic field with a magnitude up to $100\si{\milli\tesla}$ \cite{olson:2016,olson:2021}. The current through the three internal drive coils (purple) ramps up to create a magnetic field that opposes and reconnects with the background Helmholtz field, resulting in an anti-parallel magnetic configuration (e.g. no significant guide field). The plasma source is a set of plasma guns located at the machine's pole (shown in yellow). TREX can operate in hydrogen, deuterium and helium plasmas; results presented in this paper will focus on hydrogen and deuterium.\add[]{ As will be described in the following sections, the interpretation of the experimental results are aided by 2D simulations at the full hydrogen/electron mass ratio ($m_i/m_e=1836$). For numerical tractability, 3D simulations were implemented with a mass ratio of $m_i/m_e=400$.}

\begin{figure}
\includegraphics[width=\textwidth]{fig1_allfigure_wide.pdf}
\caption{(a) Engineering sketch of TREX. The internal drive coils (purple) drive a magnetic field that opposes the external Helmholtz coil's field. The plasma source is a polar array of plasma guns (yellow). (b) A cross-section of the top half of the TREX vessel showing a theoretical example of the typical experimental geometry. The magnetic field lines are shown in cyan. The reconnection region (light orange) is driven down from the drive coils to the central axis, as indicated by the arrows. The layer is measured during this transit by the three probes shown: the 3-axis linear $\mathbf{\dot{B}}$ probe array (blue), the speed probe (long red), and the multi-tip Langmuir temperature/density probe, known as the $T_e$ probe (short red). The hook probe, another array of 3-axis $\mathbf{\dot{B}}$ probes can be scanned through the shaded green area, allowing for the compilation of data from multiple experimental shots. These probes operate on sampling frequencies on the order of $10\si{\mega\hertz}$, while the elapsed time between the layer's generation and its arrival at the central axis is on the order of $20\si{\micro\second}$}.
\label{fig:schematic}
\end{figure}

In the planar cut of TREX shown in Fig.~\ref{fig:schematic}(b), the cyan lines are theoretically-derived magnetic flux contours meant to illustrate the typical magnetic geometry of an experimental run. As the current through the drive coils ramps up, the reconnection region is pushed from underneath the drive coils radially inward (orange arrows in Fig.~\ref{fig:schematic}(b)). During this transit, the reconnection layer ``jogs" past the electrostatic and magnetic probes. Given the near constant speed of the reconnection layer, this facilitates high spatial resolution measurements of the entire layer geometry over the course of a single experimental shot; this type of measurement is referred to as the jogging method. These probes and their locations are represented by the blue and red rectangles in Fig.~\ref{fig:schematic}(b). In addition to these jogging method probes, a different array of 3-axis $\mathbf{\dot{B}}$ probes can be moved between shots, allowing for the creation of multi-shot datasets. The coverage area of this probe is given by the light green rectangle in Fig.~\ref{fig:schematic}(b). By compiling data from multiple shots taken at different location, this probe provides information about the reconnection geometry without relying on the jogging method.

\begin{figure}
\includegraphics[width=\textwidth]{fig2_allfigure_wide.pdf}
\caption{Example of experimental data. Plots (a) and (b) show the data from the hook probe recorded in a scan including $34$ different probe positions covering the green region in Fig.~\ref{fig:schematic}(b). The black lines are contours of the flux function, $\Psi$, which map to the magnetic field lines. (a) shows the reconnecting magnetic fields, and (b) shows the out-of-plane current layer. (c) shows data from the $T_e$ probe (short red in Fig.~\ref{fig:schematic}(b)); the shaded regions represent the $95\%$ confidence interval for the values of density and temperature based on the fit of the probe's IV curve. The lower $R$ side of the layer is closer to the plasma sources and thus has a higher density than the other side of the layer. There is a jump in the plasma temperature when the layer passes the probe. The data in (c) is compiled using the jogging method to convert the time signal into a measurement of the $R$-coordinate.}
\label{fig:exampledata}
\end{figure}

An example of data collected from a typical set of experimental shots is provided in Fig.~\ref{fig:exampledata}, where Fig.~\ref{fig:exampledata}(a-b) shows data from $34$ shots combined into one picture; for each shot, the hook probe is at a different position within the green region in Fig.~\ref{fig:schematic}(b). The black lines are contours of the flux function $\Psi$ to illustrate the in-plane magnetic field lines. Fig.~\ref{fig:exampledata}(c) shows the temperature and density data measured by the $T_e$ probe. Note that in Fig.~\ref{fig:exampledata}(c), the time signals from the $T_e$ probe are converted into position data using the jogging method described above. Typical plasma parameters include $T_i\ll T_e\simeq 5 - 20 \si{\electronvolt}$, $n_e\simeq 2\cdot10^{18} \si{\meter}^{-3}$, $B_{rec}\simeq 4\si{\milli\tesla}$, yielding $\beta_e\simeq 0.4$ and $S\simeq 10^4$.

\section[sec:vpic]{2D and 3D Kinetic Simulations of TREX}

\begin{figure}
\includegraphics[width=\textwidth]{fig3_exp_2d_3d_ion_v9-01.png}
\caption{Comparison of TREX experimental data from a scan of the hook probe (green in Fig.~\ref{fig:schematic}(b)) with cylindrical VPIC runs in both 2 and 3 dimensions. The 2D run is at full mass ratio, and the 3D run is at a mass ratio of 400. The 3D run plots show data taken from a single value of $\phi$. Each row of plots for a different magnetic feature shows contours of the magnetic flux function $\psi$ in black. Each row has been scaled relative to the same magnitude, shown in the leftmost plot of each row. (a-c) compare the in-plane ($B_z$); (d-f) show out-of-plane ($B_{\phi}$) magnetic fields. (g-i) show the out-of-plane current density ($J_{\phi}$); (j-l) show the in-plane ($J_z$) current structures. Plots (m) and (n) show experimental data from the linear probe (blue in Fig.~\ref{fig:schematic}(b)) using the jogging method. The jogging method provides a high spatial resolution of $\sim$ $0.4$ $\si{\centi\meter}$ in the $R$ direction. Plot (m) shows a mostly laminar layer with some bifurcation, whereas plot (n) shows a plasmoid being ejected from the reconnection region. Plot (o) is a standard Ohm's Law analysis of the 2D VPIC simulation, along the path indicated by the magenta line in plot (k). The dashed cyan line is the location of the $B_z$ $=$ $0$ point along the line; the dashed black line is the location of the maximum out-of-plane current density.}
\label{fig:vpiccomp}
\end{figure}

TREX was simulated using VPIC, a kinetic particle-in-cell code \cite{bowers:2009,2018APS..DPPC11023D,bowers_2020}. The TREX boundary conditions were implemented in the new Cylindrical VPIC code with conducting walls at $R=1.5\si{\meter}$ and $Z= \pm 1.5\si{\meter}$, as well as an additional conducting wall at an adjustable minimum (nonzero) $R$ near the central axis. Within the simulation domain, current sources with the same dimensions as the TREX drive coils were added at the drive coil locations. The current density at these locations is increased as a function of time to mimic the ramping current injection utilized in the experiment. Using density data from TREX, initial density and magnetic field profiles were set at the simulation start time to balance the magnetic and kinetic pressures for a given applied Helmholtz field. Electron-electron, electron-ion, and ion-ion collisions were implemented in some 2D runs with a Monte-Carlo collision operator for binary Coulomb collisions \cite{takizuka1977}. The collision frequencies were calculated from TREX data. Not all simulations implemented collisions; results from testing a range of 2D simulation collision parameters at relevant experimental levels showed very little difference between runs with and without collisions. The 3D run discussed in this paper did not include collisions.

The \change[]{grid spacing}{number of grid-points} in the 2D simulation described here was $1512$ by $3600$ in the $R$ and $Z$ directions, respectively; in 3D, these increased to $1024$ and $2048$ respectively with another $256$ grid divisions in the $\phi$ direction. The system size in 2D was about $193$ by $399$ electron skin depths in the $R$ and $Z$ directions, respectively. In 3D, these values were $87$ and $186$ electron skin depths, respectively. The average number of super-particles per cell was $500$ in 2D and $100$ in 3D. In both simulations, the ratio of the electron cyclotron frequency to the electron plasma frequency was $1$.

Both 2D $(RZ)$ and 3D $(R\phi Z)$ simulations of TREX can be compared to experimental results; one such comparison is shown in Fig.~\ref{fig:vpiccomp}. Experimental data in subplots (a,d,g,j) come from combining multiple shots worth of experimental data from the hook probe (green in Fig.~\ref{fig:schematic}(b)).

The 2D simulation (b,e,h,k) was obtained at full mass ratio while the 3D simulation (c,f,i,l) applies $m_i/m_e = 400$. For numerical tractability, the 3D simulation is limited to a $60^{\circ}$ wedge with periodic boundaries in $\phi$. Both the experimental and simulation profiles in Fig.~\ref{fig:vpiccomp}(a-l) are displayed with the domains normalized by the local ion skin depths. Here the local ion skin depth is obtained from the value of $n_e$ in the high-density inflow (e.g., the density value shown in Fig.~\ref{fig:exampledata}(c) at $R'\sim-0.1\si{\meter}$). The scaling of simulation variables relative to experimental ones was implemented using the technique described in \citeA{egedal:2019}, where temperature and magnetic field profile matching occurred near the X-line during the reconnection process.
Further similarities between TREX and 3D Cylindrical VPIC will be discussed later in this paper.

\section[sec:background]{Inferring the Reconnection rate in the TREX geometry}

In 3D geometries the rate of reconnection is not always trivial to define \cite{hesse1993}. However, given the nominal 2D experimental setup we can define the reconnection rate as the rate at which flux upstream of the reconnection region reconnects and moves downstream.
Fig.~\ref{fig:ohm}(a) shows the different ``categories" of magnetic flux in the TREX cross-section. The red region contains field lines from the Helmholtz coil that go through the drive loop area and are upstream of the reconnection region. The blue lines are also upstream of the reconnection, but these represent the new magnetic flux injected into the system by the drive coils. Reconnection results in the downstream field lines, shown in green. The magenta field lines are those from the external Helmholtz coil that are initially above the internal drive coils and thus do not take part in the reconnection process.
We can then define the remaining unreconnected flux, $\Psi_B$, as the (red) magnetic flux between $R=0$ and the reconnection layer $\Psi_B = \int_0^{2\pi} \mathrm{d} \phi \int_0^{R_{x}(\phi)} R B_z dR$, where the integral is taken at a constant $Z$ that matches the location of the $X$-line and from $R=0$ to $R=R_x$. Here $R_x(\phi)$ is the radius of the center of the current layer which is moving radially inwards and which in the simulation is observed to be a function of $\phi$. This path of this integral is represented by the cyan line in Fig.~\ref{fig:ohm}(a).

Again, because $\Psi_B$ is the remaining un-reconnected magnetic flux, it is clear that $-d\Psi_B/dt$ is the rate at which magnetic flux is being reconnected, i.e. the reconnection rate.
There exists of course ambiguity in how to define the center of the reconnection layer $R_x(\phi)$, but as long as $R_x(\phi)$ correctly characterizes the inward motion of the reconnection layer it turns out that $-d\Psi_B/dt$ is largely unaffected by the differences between any reasonable choice of $R_x(\phi)$. By Faraday's law it is also clear that
\begin{equation}
  \label{eq:Faraday}
  -\frac{d\Psi_B}{dt} = \oint_{R_x} (\mathbf{E} + \mathbf{v}_{R_x} \times \mathbf{B}) \cdot
  d\mathbf{l} \simeq \oint_{R_x} \mathbf{E} \cdot
  d\mathbf{l} \quad.
\end{equation}
Note that in 3D for a particular choice of $R_x(\phi)$ the value of $B_z(R_x(\phi))$ could be finite and oscillate along $R_x(\phi)$, but it is reasonable to impose that for a valid choice of $R_x(\phi)$, the average value of $B_z(R_x(\phi))$ must be small. Meanwhile $ \mathbf{v}_{R_x}$ will be near constant and directed radially inward such that the average value of $ (\mathbf{v}_{R_x} \times \mathbf{B}) \cdot d\mathbf{l}$ also becomes small and can be neglected, as expressed in Eq.~\ref{eq:Faraday}.

In 3D configurations variations are permitted and likely present in $\mathbf{E}$ along
$R_x(\phi)$. However, the local electric field may always be expressed on the form $\mathbf{E}= -\nabla \Phi - \partial \mathbf{A}/\partial t$, and because for any $\Phi$ we have
$\oint_{R_x} \nabla \Phi \cdot d\mathbf{l} =0$, it becomes clear that the reconnection electric field defined as
\begin{equation}
  \label{eq:Erec}
  E_{\rm rec} \equiv -\frac{1}{2\pi\left<R_x\right>} \frac{d\Psi_B}{dt}
  = \frac{1}{2\pi\left<R_x\right>}
    \oint_{R_x} -\frac{\partial \mathbf{A}}{\partial t} \cdot
  d\mathbf{l} \quad,
  \end{equation}
is a measure of the average toroidal inductive electric field, not directly dependent on any electrostatic electric fields $-\nabla \Phi$ which may be present in the reconnection region.

The physics that allows the electron fluid, with bulk velocity $\mathbf{v_e}$, to decouple from the motion of the magnetic field can be analyzed using the momentum equation of the electron fluid (the generalized Ohm's law), which takes the form:
\begin{eqnarray}
\mathbf{E}  =  - \mathbf{v_e} \times \mathbf{B} +
\eta \mathbf{J_e} - \frac{1}{ne} \boldsymbol\nabla \cdot \mathbf{P_e} - \frac{m_e}{e}\frac{\mathrm{d} \mathbf{v_e}}{\mathrm{d} t}
\label{eq:ohme}
\end{eqnarray}
Here $\mathbf{P_e}$ is the electron pressure tensor, with elements $p_{ij} = m \int \left( u_i-v_{e,i}\right) \left( u_j-v_{e,j} \right) f \mathrm{d}^3u$, $\mathbf{v_e}$ is the bulk electron fluid velocity, and $\mathrm{d}/\mathrm{d} t$ is the total convective derivative, $\mathrm{d}/\mathrm{d} t = \partial/\partial t + \mathbf{v_e} \cdot \boldsymbol\nabla$.

In particular for the pressure tensor, we may split its contributions into its scalar and off-diagonal parts $\mathbf{P_e} =
p_e\mathbf{I}+ \boldsymbol{\pi}$, where trace$(\boldsymbol{\pi})=0$.
As discussed above, the reconnection rate $E_{\rm rec}$ is proportional to the $R_x(\phi)$-average of $\mathbf{E}$, and it becomes clear that while $-\nabla p_e$ contributions can be important to balance local electrostatic components of $\mathbf{E}$, the total contribution is $0$ because $\oint \nabla p_e \cdot d\mathbf{l} =0$. Thus, the $\boldsymbol\nabla \cdot \mathbf{P_e}$ term only contributes to reconnection through the off-diagonal stress in $\boldsymbol{\pi}$.

An analysis of the generalized Ohm's Law for a 2D VPIC simulation of TREX is shown in Fig.~\ref{fig:vpiccomp}(o), where the terms of Ohm's Law are evaluated along the path defined by the magenta line in Fig.~\ref{fig:vpiccomp}(k). Given the boundary conditions of this simulation, this analysis does not include any form of spatial averaging, resulting in some fluctuation in the net Ohm's law term (the black line in Fig.~\ref{fig:vpiccomp}(o)); nonetheless, the pressure tensor divergence term (green) is clearly the dominant contributor to the reconnection electric field (red), consistent with prior 2D simulations of low-collisionality asymmetric reconnection, including \citeA{egedal:2018}.

\section[sec:resultsohm]{Ohm's Law Results from 3D Simulations of TREX}

\begin{figure}
\includegraphics[width=\textwidth]{fig4_allfigure_wide_editlegend.png}
\caption{ a) Block diagram of TREX's theoretical magnetic geometry, demonstrating the different regions of flux relative to the location of the reconnection layer. Blue and red are upstream of the reconnection region, starting from the drive coils and the Helmholtz coil, respectively. The green lines are downstream of the reconnection region, and the magenta lines are those that originate from the Helmholtz coil but are above the drive coils and thus do not impact the reconnection process. The cyan line represents the path of the integral used to define the flux function $\Psi$. b) Cuts of the current density, $|{\bf J}_e|$, in a 3D kinetic simulation of TREX implemented as a $60^{\circ}$ degree wedge with periodic boundaries in $\phi.$ The drive coils are shown as gold surfaces. (c) Simulation profiles of of ${\bf E}_\phi$ mapped onto the $R\phi$-plane at a single value of $Z$. The black line represents the $B_z$ $=$ $0$ line. Fluctuations in ${\bf E}_\phi$ have the characteristics of the electrostatic LHDI; notably, they are stronger above the layer where the particle density is lower. The average electron cyclotron radius, $\overline{\rho}_e$, is calculated along the path marked by the small white Xs; this is one of the primary scale lengths use to describe the two modes of the LHDI. (d) Profile of $|{\bf J}_e|$ mapped onto the $R\phi$-plane at a single value of $Z$; the black line is still the $B_z$ $=$ $0$ line. Also shown in white are two different paths of integration, a straight line (labeled SL) that simply cuts through the entire $\phi$ domain and the optimized integration curve $C$. The results of integrating the different terms of Ohm's Law along path $C$ are shown in (e); the Lorentz term (red) is almost completely matched by the pressure divergence term (green), and the net Ohm's Law term (black) is consistently negligible. Also displayed are the results of integrating solely the $\protect\mathbf{v_e}$ $\times$ $\protect\mathbf{B}$ term over the straight path $SL$ (shown in magenta).}
\label{fig:ohm}
\end{figure}

The 3D simulation domain can also be seen in Fig.~\ref{fig:ohm}(b). Taking a cut through the layer reveals the development of a toroidal instability which is inferred to be the lower hybrid drift instability (LHDI). Because the LHDI is driven by diamagnetic currents, it can be more vigorous within asymmetric reconnection layers which feature strong pressure gradients in the central portion \cite{roytershteyn:2012,le:2017,le:2018}, and several of the characteristics of the LHDI \cite{daughton:2003,davidson1977} matched the numerical layer fluctuations. The fastest growing LHDI modes are short wavelength ($\rho_e k_\perp \sim 2.9$), primarily electrostatic, and are localized on the edge of the layer; these can be seen in Fig.~\ref{fig:ohm}(c). However, the LHDI features a rich spectrum \cite{daughton:2003}, with longer wavelength $\sqrt{\rho_e \rho_i} k_{\perp} \sim 1.4$ electromagnetic modes that penetrate into the center, giving rise to a global rippling of the layer in the toroidal direction; this matches the characteristics of the kinking in the $B_z = 0$ and the current layer, as shown in Fig.~\ref{fig:ohm}(b)-(d).

Given the definition of the reconnection rate in Eq.~\ref{eq:Faraday}, we may now use the generalized Ohm's Law in Eq.~\ref{eq:ohme} to examine which term is responsible for making $ \oint_C {\bf E} \cdot d{\bf l}$ finite and thereby breaking the frozen-in condition for the electrons. While the value of $ \oint_C {\bf E} \cdot d{\bf l}$ is largely insensitive to the choice for $R_X(\phi)$, we will show that the magnitude of the terms on the RHS of Eq.~\ref{eq:ohme} greatly depend on this contour of integration; this has important implications for the amplitude of the aforementioned anomalous terms due to correlated spatial fluctuations.

As mentioned, choosing a path over which to integrate is nontrivial; prior publications analysing Ohm's Law in similar parameter regimes have returned different results based on different choices of how to spatially average the relevant variables \cite{Price2017,le:2018}. A simple average over a single dimension (usually one analogous to what is here defined as our $\phi$ dimension) may pick up data from outside the diffusion region, leading to dominant terms that do not appear when an average is made over a path that has been adapted to fit the shape of the layer and any constituent instabilities \cite{che:2011,Price2017,le:2018}.

Keeping this in mind, we chose to integrate over a layer-specific path while showing the potential consequence of selecting a simple single-variable path. The simple path is shown in Fig.~\ref{fig:ohm}(d) as a white dashed straight line labeled $SL$. The black path represents the contour along which $B_z = 0$; this path was used as a starting point for an iterative process that determined the layer-specific contour $C$ (solid white curve) by minimizing the contributions of the $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ term to the path integral.

Integrating Eq.~\ref{eq:ohme} along the path C produces the terms in Fig.~\ref{fig:ohm}(e). Note that collisionality was set to $0$ in this simulation, so the resistivity term of Eq.~\ref{eq:ohme} is also $0$. The left side of Eq.~\ref{eq:ohme} (the red line) is almost completely matched at every location by the pressure-tensor-divergence term (green line). The net Ohm's Law term (black) line remains near zero at every location.

Also shown Fig.~\ref{fig:ohm}(e) is the $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ term for the $SL$ result; this is given by the magenta line. The kinking in the layer results in $SL$ including locations that are outside the dissipation region, resulting in large contributions of $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ which is the primary term for balancing $E_{\phi}$ outside the layer. By focusing on an average defined by $C$, we can minimize the $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ contributions and thus avoid drawing conclusions about the relevant terms of Ohm's Law in a manner that includes contributions from the non-reconnecting plasma regions. In previous analyses, contributions from the correlated fluctuations of the $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ term are combined with those from the pressure divergence to form the anomalous viscosity \cite{le:2018,che:2011}. These anomalous terms, when present, have been proposed as a mechanism that broaden the dissipation region and thus increase the reconnection rate \cite{parker:1957}; however, more recent results from reconnection dominated by kinetic effects show that this can be achieved without these anomalous terms becoming significant \cite{le:2018}. While there has been some disagreement about whether or not these anomalous terms are dominant in 3D kinetic reconnection \cite{che:2011,Price2017,le:2018}, our conclusion is that the answer will depend on the path used to define the spatial average. We find that the path that stays inside the diffusion region where $-en\protect\mathbf{v_e} \times \protect\mathbf{B}$ is small is the more physical choice. Furthermore, the dominant term breaking the electron frozen-in condition in the diffusion region is observed to be $\boldsymbol\nabla \cdot \mathbf{P_e}$ and is in agreement with recent spacecraft observations \cite{egedal:2019,nakamura2019}.

\section[sec:resultswidth]{Layer Width Results from Experiment and Simulation}

\begin{figure}
\includegraphics[width=\textwidth]{fig5_allfigure_wide.pdf}
\caption{Measuring layer width. (a) method for inferring the current layer half-width, $\delta_J$, defined as the half-width of the layer at $40\%$ of the maximum. (b) shows an $R\phi$ contour plot of the current layer in TREX recorded by a curved $\mathbf{\dot{B}}$ array sampling multiple toroidal angles. Three example slices at fixed $\phi$ are represented by the white dashed lines documenting variations in the layer widths.}
\label{fig:phiwidths}
\end{figure}

\begin{figure}
\includegraphics[width=\textwidth]{fig6_allfigure_wide.pdf}
\caption{Results of measuring experimental layer width over several different parameter sets. The colors highlight the difference between ``2 gun" (lower density) and a ``6 gun" (higher density) plasmas. The orange region shows the range of current layer widths measured in the 3D simulation, and the solid black line shows the result from a 2D axisymmetric simulation (without the instability). The spread in the experimental and 3D Cylindrical VPIC layer widths is attributed to the toroidal instability described in Fig.~\ref{fig:phiwidths}.}
\label{fig:layerwidth}
\end{figure}

In the above analysis of the kinetic simulation it was shown that the off-diagonal stress of $\boldsymbol\nabla \cdot \mathbf{P_e}$ is mainly responsible for breaking the electron frozen-in condition. From theory, this off-diagonal stress scales roughly as $1/\delta_J^2$, where $\delta_J$ is the half-width of the reconnection current layer \cite{hesse:1999}. Prior simulation results have established that when the current layer half-width $\delta_J$ is on the order of a few electron scale lengths (here taken to be the electron skin depth, $d_e=c/\omega_{pe}$, which at electron $\beta$ near unity is nearly equivalent to both the electron meandering width and the electron gyroradius), the pressure tensor divergence term will be sufficiently large to become the dominant term in Ohm's Law \cite{roytershteyn:2013}. This characteristic defines the regime of collisionless reconnection; as such, the measurement of layer widths on the order of the several $d_e$ can be used to establish the regime in which the reconnection is operating \cite{vasyliunas:1975,pritchett:2001}.

To address whether $\boldsymbol\nabla \cdot \mathbf{P_e}$ breaks the frozen-in condition in the experiment as it does in the simulation, we compare the widths of the current layers observed in TREX and the simulation. TREX is not yet able to measure the value of $\boldsymbol\nabla \cdot \mathbf{P_e}$ directly, but as described above, the existence of thin current layers implies that the $\boldsymbol\nabla \cdot \mathbf{P_e}$ contribution to Ohm's Law dominates the breaking of the frozen-in condition. The method of characterizing the layer half-width, $\delta_J$, is illustrated in Fig.~\ref{fig:phiwidths}(a), where the current density is recorded by the linear $\mathbf{\dot{B}}$ probe array (blue in Fig.~\ref{fig:schematic}(b)) at a set $\phi$ location for a range of $Z$ values. In addition, a toroidally curved $\mathbf{\dot{B}}$ probe array is used to characterize toroidal variations in the TREX current layers. An example dataset is shown in the top half of Fig.~\ref{fig:phiwidths}(b), documenting the intensity of the toroidal current density, with a range of different radial layer widths indicated below. This toroidal variation is similar to instability in the simulation, though the experimental observation is limited by the spatial resolution of the probe.

Note that there is also some minor variation in the layer structure in the plane perpendicular to the toroidal direction; this can be seen in the existence of several smaller peaks in the current densities plotted in the bottom of Fig.~\ref{fig:phiwidths}(b). In this plane, the layer occasionally experiences some small amount of bifurcation or other minor irregularities. Examples of such behaviour are shown in Fig.~\ref{fig:vpiccomp}(m) and (n). In this analysis, only the primary peaks in the electron current density cuts are taken into consideration.

Repeating the width measurement process for a range of experimental settings we obtain mean values for $\delta_J$ and $d_e$. The results are plotted in Fig.~\ref{fig:layerwidth}, where each data point represents the average result for $\delta_J$ and $d_e$ for a given set of drive potential, Helmholtz field, gun number, and ion species. There are approximately ten different experimental shots averaged for each data point, which include estimates for the experimental uncertainties. Also plotted is the line corresponding to the previously reported experimental results in MRX \cite{ji:2008}. The orange region represents the mean of the numerical layer widths from the 3D simulation in Fig.~\ref{fig:ohm}(b), $\pm$ a standard deviation. Similar to the experimental measurement process shown in Fig.~\ref{fig:phiwidths}(b), the numerical width results were obtained from radial cuts at different $\phi$ values relative to the phase of the instability. Finally, the width recorded in a corresponding 2D simulation in the $RZ$-plane is given by the solid black line.

The width of the current layer is physically limited by the electron meandering scale, which is slightly larger than the electron inertial scale and has only a weak dependence on the precise $\beta_e$ \cite{dorfman:2008}; in these experiments this parameter is nearly constant ($\beta_e \sim 10^{-1}$). There is a clear divide between the blue (2 guns, lower density) and red (6 guns, higher density) datapoints, as expected from $d_e \propto n_e^{-1/2}$. Additionally, even though the lower density points have larger skin depths, they also have larger layer widths, keeping them on the same scaling as the higher density datapoints. There is not a particular relationship between ion species and the experimental width scaling. Most notably, there is a general spread in measured layer widths, both relative to different parameter sets and within a given parameter set itself (demonstrated by the vertical uncertainties). This is consistent with the presence of the toroidal instability measured in TREX and demonstrated in the 3D simulations. Crucially, both the absolute values and spread of the measured current layer widths is in good agreement between the simulation and the experiment.

\section[sec:conclusion]{Conclusions}

To summarize, reconnection in TREX is characterized by thin electron current layers, consistent with kinetic simulation results. The widths include a notable spread, $\delta_J \sim ( 1.5 - 3) d_e$, which can be attributed to the development of a toroidal instability in the current layer. Compared to previous experiments in MRX, the TREX temperature ratio $T_i/T_e\ll 1$ may be more favorable to this instability \cite{roytershteyn:2012}. Nevertheless, the TREX current layers are in good agreement with those observed in a 3D kinetic simulation, and are much thinner than those observed previously in the MRX experiment.

The new Cylindrical VPIC code has allowed the TREX reconnection experiments to be modeled in a way that preserves its nominal cylindrical symmetry. Both 2D and 3D simulations reproduce the magnetic geometry measured in TREX, and 3D Cylindrical VPIC also shows the development of a toroidal instability that produces the same spread in the layer width scaling. The narrow current layers observed in TREX and their match to 3D kinetic simulation results validates the numerical result that off-diagonal stress in the electron pressure tensor is responsible for breaking the frozen-in condition for low collisionality configurations relevant to reconnection in the Earth's magnetosphere.

\acknowledgments
We gratefully acknowledge DOE funds DE-SC0019153, DE-SC0013032, and DE-SC0010463 and NASA fund 80NSSC18K1231 for support of the TREX experiment. In addition, the experimental work is supported through the WiPPL User Facility under DOE fund DE-SC0018266. Simulation work was supported by the DOE Basic Plasma Science program and by a fellowship from the Center for Space and Earth Science (CSES) at LANL. CSES is funded by LANL’s Laboratory Directed Research and Development (LDRD) program under project number 20180475DR. This work used resources provided by the Los Alamos National Laboratory Institutional Computing Program, which is supported by the U.S. Department of Energy National Nuclear Security Administration under Contract No. 89233218CNA000001. The 3D kinetic simulation was performed at the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231.

Data availability statement: Data from the 2D simulation is available at \citeA{greess_samuel_2021_4554697}. Data from the 3D VPIC simulation is available at \citeA{greess_samuel_2021_4556518}. Full figure data (both simulation and experimental) is available at \citeA{greess_samuel_2021_4837721}.

\section*{Plain Language Summary}
[ enter your Plain Language Summary here or delete this section]

\section{= enter section title =}

\acknowledgments
Enter acknowledgments, including your data availability statement, here.

\section{} command to identify level 1 heads;

Math coded inside display math mode \[ ...\]
 will not be numbered, e.g.,:
 \[ x^2=y^2 + z^2\]

 Math coded inside \begin{equation} and \end{equation} will
 be automatically numbered, e.g.,:
 \begin{equation}
 x^2=y^2 + z^2
 \end{equation}

\begin{eqnarray}
  x_{1} & = & (x - x_{0}) \cos \Theta \nonumber \\
        && + (y - y_{0}) \sin \Theta  \nonumber \\
  y_{1} & = & -(x - x_{0}) \sin \Theta \nonumber \\
        && + (y - y_{0}) \cos \Theta.
\end{eqnarray}


\section{Introduction}\label{sec:introduction}}
\else
\section{Introduction}
\label{sec:introduction}
\fi

\IEEEPARstart{H}{umans} are capable of learning stable feature representations with small training samples for dealing with image classification tasks~\cite{schmidt2009meaning}. Inspired by this ability of human, few-shot learning has attracted much attention in computer vision and pattern recognition which intends to rapidly learn a classifier with good generalization capacity for understanding new concepts from very limited numbers of labeled training examples.

Currently, the main problem of few-shot learning~\cite{li2019distribution,ijcai2020-100} is the very limited training examples of each class to effectively express a concept. In recent years, different few-shot learning methods~\cite{snell2017prototypical,wei2019piecewise,sung2018learning,li2020revisiting,zhu2020multi} have been presented to tackle fine-grained image classification tasks by learning transferable knowledge~\cite{snell2017prototypical} from an additional auxiliary dataset. The existing few-shot fine-grained image classification (FSFGIC) methods can be roughly classified into two main streams:~meta-learning based methods~\cite{wei2019piecewise,zhu2020multi} and metric-learning based methods~\cite{snell2017prototypical,li2019distribution,zhang2020deepemd}. Meta-learning based methods aim to learn meta knowledge with only a few training examples for each category. A set of functions are used for mapping labeled training image samples and test samples for visual classification. Metric-learning based methods intend to learn a group of functions for transforming test samples into the embedding space. And then the test samples will be classified into a class by a given similarity measure (e.g., nearest neighbor~\cite{snell2017prototypical} and cosine metric~\cite{li2020revisiting}).

In this work, our interest lies in addressing the metric-learning problem for FSFGIC tasks. One of the key issues of the metric-based FSFGIC methods is how to utilize a convolution neural network~\cite{vinyals2016matching, krizhevsky2017imagenet} and a similarity measure to learn a common feature representation for each category~\cite{snell2017prototypical}. Generally, mainstream metric-based FSFGIC methods follow the episodic training paradigm~\cite{vinyals2016matching}, and then image level feature representations~\cite{8658920} or a group of local feature descriptors~\cite{ijcai2020-100} from each input image are obtained for measuring the similarities~\cite{sung2018learning} between query images and support classes. Although the aforementioned methods~\cite{snell2017prototypical,sung2018learning,8658920,li2020revisiting,ijcai2020-100} have achieved a certain degree of success, given that the sample data in FSFGIC is extremely limited and the similarity between different categories in FSFGIC may be very high, we argue that projecting samples from query images and samples from support sets into a non-linear space with different non-linear projection factors and letting the designed network learn appropriate non-linear projection factors can make the distance between samples within a category smaller and the distance between samples from different categories larger and thus can effectively improve the classification performance in FSFGIC.

Currently, four convolutional blocks (i.e.,~\textit{Conv-64F}~\cite{vinyals2016matching}) are widely used in meta-learning based FSFGIC tasks~\cite{finn2017model, munkhdalai2018rapid, zhu2020multi} and metric-learning based FSFGIC tasks~\cite{li2020revisiting, huang2020low, ijcai2020-100}. Feature structure maps~\cite{finn2017model, munkhdalai2018rapid, zhu2020multi, li2020revisiting, huang2020low, ijcai2020-100} extracted from an input image with a single scale are used as descriptors for calculating the relationships between query images and support sets and performing FSFGIC. They follow the idea~\cite{girshick2015fast, ren2016faster} that descriptors extracted on a single scale image have a good trade-off between classification accuracy and speed. Our research indicates that they utilized the descriptors with strong semantic information for FSFGIC, but ignored the useful information of finer details in an image.

In this paper, we propose to formalize the FSFGIC as a feature distribution problem and design a novel non-linear data projection based metric learning network (NDPNet) for tackling the classification problems of FSFGIC. Firstly, we design a novel feature re-abstraction embedding network that has the ability to extract descriptors with detail re-enhanced semantic information from input images with a single scale. Meanwhile, a group of feature descriptors with detail re-enhanced semantic information are used to represent each test image. Secondly, a novel non-linear data projection strategy is designed to make the distance between the samples within the same class smaller and the distance between samples of different classes larger. Thirdly, a novel non-linear data projection based similarly measure is designed for obtaining the relationships between query samples after non-linear projection and support classes after non-linear projection. Finally, the Adam optimization method~\cite{kingma2014adam} with a cross-entropy loss is employed to train the whole network for learning the weights (including appropriate non-linear projection factors) and performing FSFGIC tasks.

The main contributions of our proposed method are as follows:

$\bullet$ A novel feature re-abstraction embedding network is designed which is capable of representing a sample by a set of feature representations with detail re-enhanced semantic information from an input image.

$\bullet$ A novel non-linear data projection strategy is designed for making the distance between the samples within the same class smaller and the distance between samples from different classes larger.

$\bullet$ A novel non-linear data projection based metric learning network is designed to learn appropriate non-linear projection factors for performing FSFGIC tasks.

Experiments on four fine-gained image classification benchmark datasets exhibit that our proposed method outperforms the state-of-the-art methods on various FSFGIC tasks.

\section{Related Works}
The existing FSFGIC methods can be roughly classified into two groups: meta-learning based FSFGIC methods and metric-learning based FSFGIC methods. We briefly review the two main streams in the FSFGIC literature as follows.

{\bf Meta-learning based FSFGIC methods.} The meta-learning based FSFGIC methods~\cite{thrun1998lifelong,thrun1998learning} aim to train a meta-learner which learns how to update the parameters of a given initial model with only a few training examples for each category. In order to more effectively distinguish some subtle and local differences between different fine-grained categories, recent meta-learning works have been presented for tackling FSFGIC tasks by considering how to more effectively capture subtle differences from limited training samples such as a piecewise mapping strategy~\cite{wei2019piecewise} and a multi-attention mechanism~\cite{zhu2020multi}.

Although the existing meta-learning based methods have achieved competitive results for FSFGIC, it is a difficult task to train a sophisticated memory addressing framework because of the temporally-linear hidden state dependencies~\cite{mishra2017simple}. In contrast, the proposed NDPNet architectures can be easily embedded into the episodic training mechanism for end-to-end training from scratch.

{\bf Metric-learning based FSFGIC methods.} The metric-learning based FSFGIC methods~\cite{vinyals2016matching,snell2017prototypical,li2019distribution,zhang2020deepemd,li2020revisiting,zhang2020deepemd,ijcai2020-100} aim to learn a transferable feature knowledge and obtain a distribution based on similarity metrics between different categories. Inspired by the Siamese neural network~\cite{koch2015siamese} and the episodic training mechanism~\cite{vinyals2016matching}, Prototypical-Net~\cite{snell2017prototypical} was proposed for few-shot learning tasks. In~\cite{snell2017prototypical}, a prototype was designed as the mean of embedded support examples for each class, and then Euclidean distance is used as the metric measure for FSFGIC.

\begin{figure*}[!htbp]
\setlength{\abovecaptionskip}{5pt}
\setlength{\belowcaptionskip}{5pt}
\centering
\includegraphics[width=2.1\columnwidth]{fig1.jpg}
\caption{The framework of the proposed NDPNet network for a 5-way 1-shot FSFGIC task which contains two modules. (1) A feature re-abstraction embedding module. (2) A non-linear data projection based similarity measure module.}
\label{fig1}
\end{figure*}

The aforementioned metric-learning based methods utilized image level global features to represent each sample and perform few-shot learning tasks. It is worth to note that the training examples of each class are extremely limited in few-shot learning. Because local feature descriptors can more effectively represent the distribution of each category than image level global features in few-shot learning~\cite{li2019distribution,ijcai2020-100,li2020revisiting}, some recent work (e.g., covariance metric networks (CovaMNet)~\cite{li2019distribution}, adaptive task-aware local representations network (ATL-Net)~\cite{ijcai2020-100}, and deep nearest neighbor neural network (DN4)~\cite{li2020revisiting}) employed the local feature descriptors to represent each sample. And then, covariance metric~\cite{li2019distribution}, adaptive threshold for episodic attention based on classification probability~\cite{ijcai2020-100}, and cosine metric~\cite{li2020revisiting} were utilized for measuring the relationship between a query sample and each support class for FSFGIC. Compared with the aforementioned metric-learning methods (e,g., the CovaMNet~\cite{li2019distribution}, ATL-Net~\cite{ijcai2020-100}, and DN4~\cite{li2020revisiting}), the feature descriptors extracted by the proposed feature re-abstraction embedding network designed in this work has re-enhanced finer details into abstract feature representation. More important, projecting samples from query images and samples from support sets into a non-linear space with different projection factors and letting the network learn appropriate projection factors can make the distance between samples within a category smaller and the distance between samples from different categories larger, and thus can effectively improve the classification performance in FSFGIC. Experiments on fine-gained image classification benchmark datasets exhibit the superior performance from our proposed method compared with metric learning benchmarks state-of-the-arts.

\section{Methodology}
\subsection{Problem Statement}
A common few-shot fine-grained dataset includes two parts: a support set $\mathcal{\boldsymbol{S}}$ and a query set $\mathcal{\boldsymbol{Q}}$. The small support set $\mathcal{\boldsymbol{S}}$ contains $\mathcal{C}$ unseen classes, each of which has $\mathcal{K}$ labeled samples. The query set $\mathcal{\boldsymbol{Q}}$ contains unlabeled samples. Sets $\mathcal{\boldsymbol{S}}$ and $\mathcal{\boldsymbol{Q}}$ share the same label space. The goal of FSFGIC is to successfully classify each query sample $\boldsymbol{q}$ ($\boldsymbol{q}\in\mathcal{\boldsymbol{Q}}$) into a corresponding class in $\mathcal{C}$. Thus, the problem is noted as a $\mathcal{C}$-way $\mathcal{K}$-shot task. However, the training samples of each class are too limited to effectively learn transferable knowledge~\cite{ijcai2020-100}.

In this work, an auxiliary set $\mathcal{\boldsymbol{A}}$ and an episodic training paradigm~\cite{vinyals2016matching} are utilized for tackling the aforementioned problem. The auxiliary set $\mathcal{\boldsymbol{A}}$ consists of a large quantity of classes and labeled samples which are far larger than $\mathcal{C}$ and $\mathcal{K}$ respectively and can be divided into many $\mathcal{C}$-way $\mathcal{K}$-shot FSFGIC tasks $\mho$. It is worth to note that there is no intersection between the label space sets $\mathcal{\boldsymbol{A}}$ and $\mathcal{\boldsymbol{S}}$. For each $\mho$, it consists of an auxiliary support set $\mathcal{\boldsymbol{A_S}}$ and an auxiliary query set $\mathcal{\boldsymbol{A_Q}}$. In the episodic training stage, thousands of tasks $\mho$ will be constructed for training the transferable knowledge. Once the transferable knowledge is obtained, each sample from $\mathcal{\boldsymbol{Q}}$ will be classified into one class in set $\mathcal{\boldsymbol{S}}$.

\subsection{The Proposed NDPNet}
The overview of our proposed NDPNet framework for FSFGIC is illustrated in Fig.~\ref{fig1}. It contains two main modules: a feature re-abstraction embedding (FRaE) module and a non-linear data projection based similarity measure (NDP-SM) module.~The feature re-abstraction embedding module is designed to feature representations with detail re-enhanced semantic information for all samples. After that, a similarity measure module is designed to compute the relationships of the learned feature representations between a query sample $\mathcal{\boldsymbol{q}}$ and each support class $\mathcal{\boldsymbol{S}}$. Predominantly, our proposed NDPNet architecture can be trained in an end-to-end manner from scratch. In the following, the proposed feature re-abstraction embedding module and the similarity measure module are presented in detail.

{\bf Feature Re-abstraction Embedding Module.} Four convolutional blocks (i.e.,~\textit{Conv-64F}~\cite{vinyals2016matching}) are widely used in meta-learning based FSFGIC tasks~\cite{finn2017model, munkhdalai2018rapid, zhu2020multi} and metric-learning based FSFGIC tasks~\cite{vinyals2016matching, snell2017prototypical, satorras2018few, li2019distribution, li2020revisiting, huang2020low, ijcai2020-100}. They utilized the most abstract descriptors from the deepest layer that contains strong semantic information for FSFGIC as shown in Fig.~\ref{fig4}(a). Here, we design a novel feature re-abstraction embedding network as shown in Fig.~\ref{fig4}(b), to re-enhance the most abstract feature with finer details ($\Omega_{1}$, $\Omega_{2}$, $\Omega_{3}$, $\Omega_{4}$) and re-abstract back to its most abstract form for metric learning in the next module.

\begin{figure}[!htbp]
\setlength{\abovecaptionskip}{5pt}
\setlength{\belowcaptionskip}{5pt}
\centering
\includegraphics[width=1.01\columnwidth]{fig9.jpg}
\caption{(a) The framework of the existing four convolutional blocks. (b) Our proposed feature re-abstraction embedding network.}
\label{fig4}
\end{figure}

The detailed framework of our designed feature re-abstraction embedding network is shown in Fig.~\ref{fig2}. Each convolutional block consists of a convolutional layer, a batch normalization layer, and a Leaky ReLU layer. In addition, a $2\times 2$ max pooling layer is attached to the first two convolutional blocks. It is worth to note that 64 filters with a size of $3\times 3$ are utilized in the convolutional layer. For an input image $\mathit{\boldsymbol{X}}$ ($\mathit{\boldsymbol{X}}\in\mathcal{\boldsymbol{S}}\cup\mathcal{\boldsymbol{Q}}$) with a size of $N\times N$, through the first convolutional block, 64 feature tensors with a size of $\frac{N}{2}\times \frac{N}{2}$ can be obtained which is named as $\Omega_{1i}$ ($i=1,2,...,64$). And then three sets of 64 feature tensors with a size of $\frac{N}{4}\times \frac{N}{4}$, which are named as $\Omega_{2i}$, $\Omega_{3i}$, and $\Omega_{4i}$ ($i=1,2,...,64$), can be obtained after the second, third, and fourth convolutional blocks.

\begin{figure*}[!htbp]
\setlength{\abovecaptionskip}{5pt}
\setlength{\belowcaptionskip}{5pt}
\centering
\includegraphics[width=2.07\columnwidth]{fig22.jpg}
\caption{The feature re-abstraction embedding module.}
\label{fig2}
\end{figure*}

In this work, feature tensors obtained from the second, third, and fourth convolution block (i.e., $\Omega_{2i}$, $\Omega_{3i}$, and $\Omega_{4i}$ ($i=1,2,...,64$)) are combined as follows
\begin{equation}\begin{aligned}
\label{eq1}
\Upsilon_{i}&=\Omega_{2i}+\Omega_{3i}+\Omega_{4i},\\
i&=1,2,...,64.
\end{aligned}\end{equation}
For the combined tensors $\Upsilon_{i}$ ($i=1,2,...,64$), we upsample their corresponding spatial resolution with a scaling factor of 2
\begin{equation}\begin{aligned}
\label{eq2}
\Psi_{i}&=\uparrow_{2}\Upsilon_{i},\\
i&=1,2,...,64,
\end{aligned}\end{equation}
where $\uparrow_{2}$ denotes a bilinear upsampling operator with the scaling factor of 2. And then, the upsampled tensor $\Psi_{i}$ is merged with tensor $\Omega_{1i}$ ($i=1,2,...,64$) as
\begin{equation}\begin{aligned}
\label{eq3}
\aleph_{i}&=\Psi_{i}+\Omega_{1i},\\
i&=1,2,...,64.
\end{aligned}\end{equation}
Furthermore, a convolutional layer (with 64 filters of size 3$\times$3) is attached to the merged tensor $\aleph_{i}$ for reducing the aliasing effect caused by upsampling and obtaining 64 tensors $\xi_{i}$ ($i=1,2,...,64$) with a size of $\frac{N}{2}\times \frac{N}{2}$. Then, a $2\times 2$ max pooling layer is attached to the convolutional layer for obtaining feature tensor maps $\lambda_{i}$ ($i=1,2,...,64$). Finally, the feature values at the same coordinate position on different feature tensor maps are used to construct a feature descriptor. The descriptor is constructed from feature maps of different resolutions, and it contains the semantic information of the original deepest feature tensor map, so it has strong detail re-enhanced semantic characteristics.

In conclusion, through the designed feature embedding module, an input image $\mathit{\boldsymbol{X}}$ can be represented as a group of $d\times(h\times w)$-dimensional descriptors as follows
\begin{equation}\begin{aligned}
\label{eq4}
\Theta(\mathit{\boldsymbol{X}})=[\boldsymbol{x}_{1},...,\boldsymbol{x}_{j},...,\boldsymbol{x}_{m}]\in R^{d\times(h\times w)},
\end{aligned}\end{equation}
where $\boldsymbol{x}_{j}$ is the $j$-th descriptor, $h$ and $w$ denote the height and width of the feature tensor map respectively, $d$ (here $d=64$) is the number of filters, $R$ represents real space, and $m$ ($m=h\times w$) is the total number of descriptors for the input image $\mathit{\boldsymbol{X}}$. Meanwhile, the $m$ descriptors can be used as the representations of image $\mathit{\boldsymbol{X}}$.

\begin{figure*}[!htbp]
\setlength{\abovecaptionskip}{5pt}
\setlength{\belowcaptionskip}{5pt}
\centering
\includegraphics[width=2.05\columnwidth]{fig3.jpg}
\caption{The framework of non-linear data projection based similarity measure module.}
\label{fig3}
\end{figure*}

{\bf Non-linear Data Projection based Metric Learning.} In this module, a novel non-linear data projection strategy is designed to make the distance between the descriptors within a class smaller and the distance between descriptors of different classes larger.

Through the designed feature re-abstraction embedding module, the descriptors of a query sample $\mathit{\boldsymbol{q}}$ and a support sample $\mathit{\boldsymbol{s}}$ can be represented as $\Theta(\mathit{\boldsymbol{q}})=[{\boldsymbol{q}}_{1},...,{\boldsymbol{q}}_{m}]\in R^{d\times(h\times w)}$ and $\Theta(\mathit{\boldsymbol{s}})=[{\boldsymbol{s}}_{1},...,{\boldsymbol{s}}_{m}]\in R^{d\times(h\times w)}$ respectively. For descriptors ${\boldsymbol{q}}_{j}$ and ${\boldsymbol{s}}_{j}$ $(j=1,...,m)$, standardization operation is performed as
\begin{equation}\begin{aligned}
\label{eq99}
\ddot{\boldsymbol{q}}_{j}&=\frac{\boldsymbol{q}_j-M(\boldsymbol{q}_j)}{\sqrt{D(\boldsymbol{q}_j)}},\\
\ddot{\boldsymbol{s}}_{j}&=\frac{\boldsymbol{s}_j-M(\boldsymbol{s}_j)}{\sqrt{D(\boldsymbol{s}_j)}},\\
j&=1,...,m,
\end{aligned}\end{equation}
where $M(\cdot)$ denotes the mean measure and $D(\cdot)$ denotes the variance measure. For each element $a_{u}$ and $b_{u}$ $(u=1,...,64)$ in the standardized descriptors $\ddot{\boldsymbol{q}}_{j}$ and $\ddot{\boldsymbol{s}}_{j}$~$(j=1,...,m)$, a non-linear projection is designed as follows
\begin{equation}\begin{aligned}
\label{eq9}
\hat{a}_{u}&=\text{sign}(a_{u})\bigg(1-\text{exp}\bigg(-\frac{a^2_{u}}{2\alpha^2}\bigg)\bigg),\\
\hat{b}_{u}&=\text{sign}(b_{u})\bigg(1-\text{exp}\bigg(-\frac{b^2_{u}}{2\beta^2}\bigg)\bigg),
\end{aligned}\end{equation}
where $\alpha$ and $\beta$ denote the non-linear projection factors and $\text{sign}(\cdot)$ denotes the $\text{sign}$ function. Then the descriptors of a query sample $\mathit{\boldsymbol{q}}$ after non-linear projection and a support sample $\mathit{\boldsymbol{s}}$ after non-linear projection can be expressed as $\Theta(\mathit{\boldsymbol{q}})=[\hat{\boldsymbol{q}}_{1},...,\hat{\boldsymbol{q}}_{m}]\in R^{d\times(h\times w)}$ and $\Theta(\mathit{\boldsymbol{s}})=[\hat{\boldsymbol{s}}_{1},...,\hat{\boldsymbol{s}}_{m}]\in R^{d\times(h\times w)}$ respectively.

The framework of non-linear data projection based similarly metric-learning module is shown in Fig.~\ref{fig3}. In this work, the inner product is employed for measuring the similarities of feature information between a query image after non-linear projection and a support class after non-linear projection for performing FSFGIC tasks.

For each $\hat{\boldsymbol{q}}_{j}$~$(j=1,...,m)$, the inner product measure is used to find its corresponding $k$-nearest neighbors $\boldsymbol{\alpha}_{j}^{t}\vert_{t=1}^{k}~(j=1,...,m)$ from $\Theta(\mathit{\boldsymbol{s}})$ based on the nearest-neighbor method~\cite{boiman2008defense} as follows
\begin{equation}\begin{aligned}
\label{eq5}
&\Lambda(\hat{\boldsymbol{q}}_{j},\hat{\boldsymbol{s}}_{\tau})=\vert<\hat{\boldsymbol{q}}_{j},\hat{\boldsymbol{s}}_{\tau}>\vert,\\
&\zeta=sort\{\Lambda(\hat{\boldsymbol{q}}_{j},\hat{\boldsymbol{s}}_{1}),...,\Lambda(\hat{\boldsymbol{q}}_{j},\hat{\boldsymbol{s}}_{m})\},\\
&\boldsymbol{\alpha}_{j}^{t}=\hat{\boldsymbol{s}}_{\zeta_{t}},\\
&t=1,...,k,~j=1,...,m,~\tau=1,...,m,
\end{aligned}\end{equation}
where $<\cdot>$ stands for an inner product measure, $\vert\cdot\vert$ stands for an absolute value function, $sort$ denotes the operation of arranging the values of the array from the largest to the smallest, $\zeta$ represents the sequence number corresponding to the descriptor $\hat{\boldsymbol{s}}_{\tau}$ ($\tau=1,...,m$) arranged in descending order of the similarity with the descriptor $\hat{\boldsymbol{q}}_{j}$, $\boldsymbol{\alpha}_{j}^{t}$ represents $k$ descriptors $\hat{\boldsymbol{s}}_{\zeta_{t}}~(t=1,...,k)$ that are most similar to descriptor $\hat{\boldsymbol{q}}_{j}$. Then, the non-linear data projection based similarity measure $\Re(\mathit{\boldsymbol{q}},\mathit{\boldsymbol{s}})$ between a query sample $\mathit{\boldsymbol{q}}$ and a support sample $\mathit{\boldsymbol{s}}$ is defined as
\begin{equation}\begin{aligned}
\label{eq6}
\Re(\mathit{\boldsymbol{q}},\mathit{\boldsymbol{s}})=\sum_{j=1}^{m}\sum_{t=1}^{k}\vert<\hat{\boldsymbol{q}}_{j},\boldsymbol{\alpha}_{j}^{t}>\vert.
\end{aligned}\end{equation}
In this work, $k$ is set to 1.

Furthermore, we extend the non-linear projection based inner product similarity measure to compute the similarity between a query sample and each support class for FSFGIC tasks. Specifically, the descriptors of a query sample $\mathit{\boldsymbol{q}}$ and a support class $\boldsymbol{\mathit{S}}$ can be represented as $\Theta(\mathit{\boldsymbol{q}})=[\hat{\boldsymbol{q}}_{1},...,\hat{\boldsymbol{q}}_{m}]\in R^{d\times(h\times w)}$ and $\Theta(\boldsymbol{\mathit{S}})=[\Theta(\mathit{\boldsymbol{X}_1}),...,\Theta(\mathit{\boldsymbol{X}_{\mathcal{K}}})]\in R^{d\times(h\times w\times {\mathcal{K}})}$ respectively, where ${\mathcal{K}}$ is the number of samples in support class $\boldsymbol{\mathit{S}}$. From Equation~(\ref{eq5}), each $\hat{\boldsymbol{q}}_{j}~(j=1,...,m)$'s corresponding $1$-nearest neighbor from the support class $\boldsymbol{\mathit{S}}$ can be represented as $\hat{\boldsymbol{s}}_{j}~(j=1,...,m)$. The non-linear data projection based image-to-class similarity measure~\cite{li2020revisiting}) is defined as
\begin{equation}\begin{aligned}
\label{eq7}
\Im(\mathit{\boldsymbol{q}},\boldsymbol{\mathit{S}})=\sum_{j=1}^{m}\vert<\hat{\boldsymbol{q}}_{j},\hat{\boldsymbol{s}}_{j}>\vert.
\end{aligned}\end{equation}

And then the Adam optimization method~\cite{kingma2014adam} with a cross-entropy loss is used to train the whole network for learning the weights (including the appropriate non-linear projection factors) and performing FSFGIC tasks.

\section{Experiments}
\subsection{Datasets}
Our proposed network is evaluated on four fine-gained datasets of Stanford Dogs~\cite{khosla2011novel}, Stanford Cars~\cite{krause20133d}, CUB-200~\cite{welinder2010caltech}, and Cottons~\cite{yu2020patchy}.~The Stanford Dogs dataset consists of 120 dog classes with 20,580 samples.~The Stanford Cars dataset consists of 196 car classes with 16,185 samples. The CUB-200 dataset consists of 200 bird classes with 6,033 samples. The Cottons dataset consists of 80 cotton classes with 480 samples. For fair performance comparisons, we follow the same data split as used in~\cite{ijcai2020-100} that are illustrated in Table~\ref{tab1}.

\begin{table}[htbp]

\centering
\begin{tabular}{cccc}
\hline
{Dataset}  &$N_{train}$   & $N_{val}$  & $N_{test}$   \\
\hline
Stanford Dogs      &70  & 20 & 30    \\
Stanford Cars        & 130  & 17  & 49        \\
CUB-200      & 130  & 20  & 50         \\
Cottons      & 51  & 13  & 16         \\
\hline
\end{tabular}
\setlength{\abovecaptionskip}{10pt}
\setlength{\belowcaptionskip}{10pt}
\caption{The class split of four fine-grained datasets. $N_{train}$, $N_{val}$, and $N_{test}$ are the numbers of classes in the auxiliary set, validation set, and test set respectively.}
\label{tab1}
\end{table}

\subsection{Experimental Setup}
In this work, both the 5-way 1-shot and 5-way 5-shot FSFGIC tasks are performed on the aforementioned four datasets. Each input image is resized to a fixed size of $100\times100$ and randomly cropped into $84\times84$. Random affine transformations, random horizontal flips, and random rotations are utilized for data augmentation. We randomly sample and construct 300,000 episodes for training our models by utilizing the episodic training paradigm~\cite{vinyals2016matching}. For each episode, 15 query samples per class are randomly selected for the datasets of Stanford Dogs, Stanford Cars, and CUB-200 respectively. Because each class has only six samples in the Cottons dataset, 5 and 1 query samples are selected from each cotton class for the 1-shot and 5-shot settings respectively. The Adam optimization method~\cite{kingma2014adam} is utilized for training the models using 30 epochs. The learning rate is initially set as 0.001 and multiplied by 0.5 for every 100,000 episodes.

In the testing stage, 600 episodes are randomly constructed from the testing set for obtaining the results. The top-1 mean accuracy is employed as the evaluation criteria. The aforementioned process is repeated five times and the final mean results are obtained as the classification accuracy of FSFGIC. Meanwhile, the $95\%$ confidence intervals are obtained and reported.

\begin{table*}[htp]

\renewcommand{\arraystretch}{1.2}
\centering

\begin{tabular}{ccccccc}

\hline
\multirow{3}*{Model}  & \multicolumn{5}{c}{5- Way Accuracy (\%)}\\
\cline{2-7}
 & \multicolumn{2}{c}{Stanford Dogs} &\multicolumn{2}{c}{Stanford Cars} &\multicolumn{2}{c}{CUB-200}\\
 \cline{2-3} \cline{4-5}  \cline{6-7}
  & {5-way 1-shot} &{5-way 5-shot} &{5-way 1-shot} & {5-way 5-shot}&{5-way 1-shot} &{5-way 5-shot} \\
 \hline
 Matching Net        &35.80$\pm$0.99 &47.50$\pm$1.03 &34.80$\pm$0.98 &44.70$\pm$1.03 &45.30$\pm$1.03 &59.50$\pm$1.01\\
 P-Net    &37.59$\pm$1.00 &48.19$\pm$1.03 &40.90$\pm$1.01 &52.93$\pm$1.03 &37.36$\pm$1.00 &45.28$\pm$1.03\\
 GNN                 &46.98$\pm$0.98 &62.27$\pm$0.95 &55.85$\pm$0.97 &71.25$\pm$0.89 &51.83$\pm$0.98 &63.69$\pm$0.94\\
 CovaMNet            &49.10$\pm$0.76 &63.04$\pm$0.65 &56.65$\pm$0.86 &71.33$\pm$0.62 &52.42$\pm$0.76 &63.76$\pm$0.64\\
 DN4                 &45.41$\pm$0.76 &63.51$\pm$0.62 &59.84$\pm$0.80 &88.65$\pm$0.44 &46.84$\pm$0.81 &74.92$\pm$0.64\\
PABN$+_{cpt}$              &45.65$\pm$0.71 &61.24$\pm$0.62 &54.44$\pm$0.71 &67.36$\pm$0.61 &63.36$\pm$0.80 &74.71$\pm$0.60\\
$\text{LRPABN}_{cpt}$  &45.72$\pm$0.75 &60.94$\pm$0.66 &60.28$\pm$0.76 &73.29$\pm$0.58 &63.63$\pm$0.77 &76.06$\pm$0.58\\
 ATL-Net             &54.49$\pm$0.92 &73.20$\pm$0.69 &67.95$\pm$0.84 &89.16$\pm$0.48 &60.91$\pm$0.91 &77.05$\pm$0.67\\

Our NDPNet           &{\bf 56.21$\pm$0.86} & {\bf 74.82$\pm$0.84} & {\bf 71.48$\pm$0.89 }&{\bf  91.92$\pm$0.91 }&  {\bf64.74$\pm$0.90} &{\bf 80.52$\pm$0.63}\\

\hline

\end{tabular}
\caption{\label{tab:test}Comparison results on three different standard datasets.}
\label{t2}
\end{table*}

\subsection{Performance Comparison}
The experimental results on Stanford Dogs, Stanford Cars, CUB-200, and Cottons datasets are presented in Table~\ref{t2} and Table~\ref{t3} and compared with eight state-of-the-art metric learning methods (i.e., Matching Net~\cite{vinyals2016matching}, Prototypical Net (P-Net)~\cite{snell2017prototypical}, GNN~\cite{satorras2018few}, CovaMNet~\cite{li2019distribution}, DN4~\cite{li2020revisiting}, PABN$+_{cpt}$~\cite{huang2020low}, $\text{LRPABN}_{cpt}$~\cite{huang2020low}, and ATL-Net~\cite{ijcai2020-100}). From Table~\ref{t2} and Table~\ref{t3}, it is observed that our proposed NDPNet method outperforms all the benchmark metric-learning methods on both 5-way 1-shot and 5-way 5-shot FSFGIC tasks. For the 5-way 1-shot and 5-way 5-shot FSFGIC tasks on the Stanford Cars dataset, our proposed NDPNet architecture achieves $36.68\%$, $30.58\%$, $15.63\%$, $14.83\%$, $11.64\%$, $17.04\%$, $11.20\%$, and $3.53\%$ improvements and $47.22\%$, $38.99\%$, $20.67\%$, $20.59\%$, $3.27\%$, $24.56\%$, $18.63\%$, and $2.76\%$ improvements over Matching Net, P-Net, GNN, CovaMNet, DN4, PABN$+_{cpt}$, $\text{LRPABN}_{cpt}$, and ATL-Net respectively. Such improvements is due to the ability of NDPNet for making the distance between the samples within the same class smaller and the distance between samples from different classes larger and reducing the coupling relationship between samples of different categories.

\begin{table}[htp]
\renewcommand{\arraystretch}{1.2}
\centering

\begin{tabular}{ccc}

\hline
\multirow{2}*{Model}   & \multicolumn{2}{c}{5-Way Accuracy (\%)}\\
\cline{2-3}
  & {1-shot} &{5-shot} \\
 \hline
 Matching Net            & 38.77$\pm$1.08 & 58.95$\pm$1.02\\
 P-Net                   & 39.12$\pm$1.03 & 60.25$\pm$1.02\\
 GNN                    & 43.91$\pm$0.71 & 68.61$\pm$0.81\\
 CovaMNet                & 46.14$\pm$0.91 & 69.97$\pm$0.89\\
  DN4                    & 45.74$\pm$0.86 & 70.36$\pm$0.95\\
PABN$+_{cpt}$            & 46.73$\pm$0.77 & 70.32$\pm$0.71\\
 $\text{LRPABN}_{cpt}$   & 46.81$\pm$0.73 & 71.82$\pm$0.99\\
 ATL-Net                 & 51.89$\pm$0.97 & 73.48$\pm$0.96\\

Our NDPNet            & {\bf 53.52$\pm$0.98} & {\bf 74.66$\pm$0.92}\\

\hline

\end{tabular}
\caption{\label{tab:test}Comparison results on the Cottons dataset.}
\label{t3}
\end{table}

\subsection{Discussion}
Below we conduct several further experiments for studying the effectiveness of the presented NDPNet architecture.

{\bf Influence of the feature re-abstraction embedding network for FSFGIC.} In this experiment, the designed embedding network in our architecture is replaced with the basic embedding network (i.e., \textit{Conv-64F}). Here, \textit{Conv-64F} is combined with our non-linear data projection based similarity measure ($\text{NDP-SM}$) module, which is denoted as $\textit{Conv-64F}+\text{NDP-SM-module}$ for performing FSFGIC tasks on the Stanford Dogs and Stanford Cars datasets. Their corresponding results on the 5-way 1-shot and 5-way 5-shot tasks are presented in Table~\ref{t4}. We can see from Table~\ref{t4} that the classification accuracies of our proposed $\text{NDPNet}$ is far better than the classification accuracy of the $\textit{Conv-64F}+\text{NDP-SM-module}$, which demonstrates the effectiveness of the proposed feature re-abstraction embedding (FRaE) module in image feature description for metric learning.

\begin{table*}[htp]
\renewcommand{\arraystretch}{1.2}
\centering

\begin{tabular}{ccccc}

\hline
\multirow{3}*{Model}  & \multicolumn{4}{c}{5- Way Accuracy (\%)}\\
\cline{2-5}
 & \multicolumn{2}{c}{Stanford Dogs} &\multicolumn{2}{c}{Stanford Cars} \\
 \cline{2-3} \cline{4-5}
  & {5-way 1-shot} &{5-way 5-shot} &{5-way 1-shot} & {5-way 5-shot} \\
 \hline
$\textit{Conv-64F}+\text{NDP-SM-module}$      & 53.17$\pm$0.92 & 69.26$\pm$0.98 &67.80$\pm$0.99 &89.70$\pm$0.83 \\
$\text{FRaENet}$               &52.59$\pm$1.03 &68.37$\pm$1.12 &65.97$\pm$0.98 &86.93$\pm$1.07\\
$\text{NDPNet}\_{\textit{Cos}}$        &55.38$\pm$0.96 &74.71$\pm$0.95 &71.10$\pm$0.98 &91.55$\pm$0.89 \\
$\text{GK\_FRaENet}$               &54.28$\pm$0.85 &73.57$\pm$0.65 &69.15$\pm$0.92 &89.25$\pm$0.91 \\
Our $\text{NDPNet}$           &{\bf 56.21$\pm$0.86} & {\bf 74.82$\pm$0.84} & {\bf 71.48$\pm$0.89 }&{\bf  91.92$\pm$0.91 }\\

\hline

\end{tabular}
\caption{\label{tab:test}The results of ablation study on the proposed NDPNet on the Stanford Dogs and Stanford Cars datasets.}
\label{t4}
\end{table*}

\begin{table*}[htp]
\renewcommand{\arraystretch}{1.2}
\centering
\begin{tabular}{ccccccc}

\hline
\multirow{3}*{Model}  & \multicolumn{5}{c}{5- Way Accuracy (\%)}\\
\cline{2-7}
 & \multicolumn{2}{c}{Stanford Dogs} &\multicolumn{2}{c}{Stanford Cars} &\multicolumn{2}{c}{CUB-200}\\
 \cline{2-3} \cline{4-5}  \cline{6-7}
  & {5-way 1-shot} &{5-way 5-shot} &{5-way 1-shot} & {5-way 5-shot}&{5-way 1-shot} &{5-way 5-shot} \\
 \hline

 $\text{NDPNet}\_\{k=5\}$          &54.71$\pm$0.74 &73.33$\pm$0.91  &70.11$\pm$0.77 &89.52$\pm$0.83 &63.18$\pm$0.88 &79.73$\pm$0.79\\
$\text{NDPNet}\_\{k=3\}$           &55.78$\pm$0.89 &73.91$\pm$0.97  &70.75$\pm$0.92 &90.31$\pm$0.99 &64.55$\pm$0.98 &80.23$\pm$0.81 \\
 $\text{NDPNet}\_\{k=1\}$           &{\bf 56.21$\pm$0.86} & {\bf 74.82$\pm$0.84} & {\bf 71.48$\pm$0.89 }&{\bf  91.92$\pm$0.91 }&  {\bf64.74$\pm$0.90} &{\bf 80.52$\pm$0.63}\\

\hline

\end{tabular}
\caption{\label{tab:test}The impact of the $k$-nearest neighbors on the proposed NDPNet on three different standard datasets.}
\label{t5}
\end{table*}

{\bf Influence of the non-linear data projection for FSFGIC.} In the following experiments, we firstly consider the classification performance of a network after removing the designed non-linear data projection strategy, which is named as $\text{FRaENet}$. The descriptors from query images and the descriptors from support classes obtained from the designed embedding network are utilized to calculate the similarities using Equations~(\ref{eq5}),~(\ref{eq6}), and~(\ref{eq7}). The $\text{FRaENet}$ is employed for performing FSFGIC tasks on the Stanford Dogs and Stanford Cars datasets. Their results on the 5-way 1-shot and 5-way 5-shot tasks are presented in Table~\ref{t4}. After removing the proposed non-linear data projection based similarity measure ($\text{NPD-SM}$) module, the classification accuracy of $\text{FRaENet}$ is significantly lower than the proposed NDPNet, which validates the effectiveness and strength of the proposed $\text{NPD-SM}$ network.

Secondly, the inner product similarity measure in our architecture is replaced with the cosine similarity measure, which is denoted as $\text{NDPNet}\_{\textit{Cos}}$, for performing FSFGIC tasks on the Stanford Dogs and Stanford Cars datasets. Their corresponding results on the 5-way 1-shot and 5-way 5-shot tasks are presented in Table~\ref{t4}. It is observed that the classification performance of the $\text{NDPNet}\_{\textit{Cos}}$ is close to the classification performance of our proposed $\text{NDPNet}$. It can also be seen from Tables~\ref{t2} and~\ref{t4} that the classification performance of the $\text{NDPNet}\_{\textit{Cos}}$ is far better than that of the cosine similarity measure based DN4~\cite{li2020revisiting} method. This indicates that the non-linear data projection strategy effectively improve the ability to identify different samples.

Thirdly, we consider the classification performance of inner product measure based Gaussian kernel function learning network, which is named as $\text{GK\_FRaENet}$, after removing the designed non-linear data projection strategy. Based on the obtained descriptors ${\boldsymbol{q}}_{j}$ and ${\boldsymbol{s}}_{j}$ $(j=1,...,m)$ from the feature re-abstraction embedding network, the $\text{GK\_FRaENet}$ is designed as follows
\begin{equation}\begin{aligned}
\label{eq8}
K({\boldsymbol{q}}_{j},{\boldsymbol{s}}_{j})&=1-\text{exp}\bigg(-\frac{\Lambda({\boldsymbol{q}}_{j},{\boldsymbol{s}}_{j})}{2\delta^2}\bigg),\\
j&=1,...,m,
\end{aligned}\end{equation}
where $\delta$ is a scale factor. It is easy to verify that the function $K({\boldsymbol{q}}_{j},{\boldsymbol{s}}_{j})$ in Equation~(\ref{eq8}) satisfies the Mercer's theorem~\cite{mercer1909xvi}. It means that the function $K({\boldsymbol{q}}_{j},{\boldsymbol{s}}_{j})$ can be used for kernel learning which is utilized to compute the relationships between query images and support classes via Equations~(\ref{eq6}) and (\ref{eq7}). The $\text{GK\_FRaENet}$ is employed for performing FSFGIC tasks on the Stanford Dogs and Cars datasets. Their corresponding results on the 5-way 1-shot and 5-way 5-shot tasks are presented in Table~\ref{t4}. We can see from Table~\ref{t4} that our proposed $\text{NDPNet}$ achieves better classification performance than the $\text{GK\_FRaENet}$. This further validates that the proposed $\text{NDP-SM}$ can be more effectively making the distance between the samples within the same class smaller and the distance between samples from different classes larger.

{\bf Influence of the $k$-nearest neighbors for FSFGIC.} The selection of parameter $k$ will affect the performance of classification. Here, we analyse the effect of the parameter $k$ in Equation~(\ref{eq5}) on the performance in performing FSFGIC tasks. 5-way 1-shot and 5-way 5-shot tasks are performed on the Stanford Dogs, Standford Cars, and CUB-200 datasets by using different $k$ ($k\in\{1,3,5\}$). Their corresponding results on the 5-way 1-shot and 5-way 5-shot tasks are presented in Table~\ref{t5}. It can be seen from Table~\ref{t5} that when $k$ equal to 1, our proposed method achieves the best classification performance. Thus, $k$-nearest neighbors with $k=1$ is recommended for our proposed architecture.

\section{Conclusions}
In this paper, we present a novel non-linear data projection network, $\text{NDPNet}$, which consists of a feature re-abstraction embedding module and a non-linear data projection based similarity measure module, for the challenging few-shot fine-grained image classification (FSFGIC). We emphasize and verify that the proposed NDPNet network is more effective for performing FSFGIC tasks. In this work, a feature re-abstraction embedding network is designed which is capable of representing a sample by a set of feature representations with detail re-enhanced semantic information. Furthermore, a novel non-linear data projection based similarity metric learning network is designed to make the distance between the samples within the same smaller and the distance between samples from different classes larger for performing FSFGIC. Our proposed method does not require extra supervision information and can be easily embedded into the episodic training mechanism for end-to-end training. Experiments on four fine-gained image classification benchmark datasets demonstrate that the presented $\text{NDPNet}$ method outperforms the state-of-the-art methods on various FSFGIC tasks.

\ifCLASSOPTIONcaptionsoff
  \newpage
\fi

\renewcommand\refname{Reference}
\bibliographystyle{IEEEtran}