\section{\textbf{Introduction}}

A Laurent polynomial $ f = f(x_1,...,x_l) $ in the noncommutative variables $x_i, \, i=1,\ldots,l$ is an element non-zero in the group algebra  $RF_l$ over a ring  $R$  with free group $F_l = < x_1,...,x_l >$. One says  $ f $ in $RF_l $ is a Laurent Polynomial Identity  ($LPI$) for an $R$ algebra $A$ (respc. for $U(A)$ the group of units in A) if $f(a_1, ..., a_l)=0 $ for all sequence $a_1,..., a_l$ in $A$ (respc. in U(A)). A word  $ w $ in $RF_l$ is group identity for all $U(A)$ if $w(a_1, ..., a_l)=1$, for  $a_1,..., a_l$ in $U(A)$ .\\

\hspace*{0,05cm}\textbf{Brian Hartley´s Conjecture}:	Let G be a torsion group and R a field. If the unit
group $U(RG)$ of $RG$ satisfies a group identity $w=1$, then RG satisfies a polynomial
identity.\\

In [2] A.Giambruno, E.Jespers and A.Valenti shows that the Brian Hartley´s Conjecture is true for a group algebra $RG$ over an infinite commutative domnain $R$ and a torsion group $G$ and $G$ has no divisible order elements by $p$ with characteristic of $R$ is $p$. For this purpose they proved the following crucial result.

\begin{prop}

	Let $A$ be an algebra  over an infinite commutative domain $R$ and suppose that $U(A)$ satisfies a group identity. There exists a positive m such that if $ \, a,b,c, u $ in $A$ and $a^{2}=bc=0$, then $bacA$ is nil right ideal of bounded exponent less or equal than m.

\end{prop}

The case identity group  $w=1$ in the conjecture says  the  unity group satisfy equivalently the Laurent polynomial  $F=  1- w  $.  We use this idea and study the case  $F=\, a_1 + a_2w_2 +...+a_n w_n $. Clearly the case $F=  1- w  $ is a special  case of our generalization.

In this paper we prove the following results. \\

 \newpage

\begin{prop}\label{p1}
	Let $A$ be an algebra with the group of units $U(A)$ admits a  $LPI$  over a ring R whith unit  whose non-constants words has the sum of exponents  non-zero at least one of the variables. Then there exists a polynomial $f \, \in \, R[X]$ with the limited degree $d\leq 4(-l+r)+3$, where $l=min \, \{\sum expw_i\}$ and $r=max\{\sum exp \, w_i \}$, determinated  by the $LPI$  such that for all $ \, a,b,c, u $ in $A$ with $a^{2}=bc=0$,  $f(bacu)=0$. In particular, $bacA$  is an algebraic ideal.

\end{prop}
As a consequence of Proposition 1.2 we prove the following:

\begin{cor1}\label{c1}
	Let $A$ be an algebra over a commutative domain R with $ \mid R \mid > d  $ whose unit group $U(A)$ has a $LPI$. If $a,\, b,\, c \in A$ with $a^2=bc=0 $, then $bacA$ is a nil ideal with limited exponent.

\end{cor1}

Notice that the restriction on $LPI$ is necessary because we will show that without this assumption Proposition 1.2 i not valid. In this article we always adopt $LPI$ with this restriction. Also, by changin $x_i$ by $x^{-i}yx^i$ we may assume that  $LPI$ in two variables.

\newpage

\textbf{\textit{Proof of Proposition \ref{p1}}: }

 Let  $P\,=\, a_1 + a_2w_2 +...+ a_r w_t$ the $LPI$ with $w_i $ in the form     $$w_i=x_1^{r_1}x_2^{s_2} \cdots x_1^{r_k}x_2^{s_k}, k\geq 1, r_i,\, s_i $$ integers. If $ \sum exp \, w_i = \sum exp _{x_1}\, w_i + \sum exp _{x_2}\, w_i = 0 $ then we  substitute $ x_1= x_1^k$ or $x_2= x_2^k$ with $k > 1$ big enough,
	We get a new $LPI$ in the form  $P\,=\, a_1 + a_2{w'}_2 +...+ a_r {w'}_r,$ where
	$$ \sum exp \, {w'}_i = \sum exp _{x_1}\, {w'}_i + \sum exp _{x_2}\, {w'}_i = k \sum exp _{x_1}\, w_i + \sum exp _{x_2}\, w_i $$  or $$\sum exp \, {w'}_i = \sum exp _{x_1}\, w_i +  k\sum exp _{x_2}\, w_i. $$     In any  case that is not zero.

	In  general,  $P(1,1)\,=\, a_1 + a_2 +...+ a_r =0$, so $ a_2 +...+ a_r \neq 0 $ , because $a_1 \neq 0$. Hence any collection of sums with distinct parcels involving all coefficients  $ a_2,..., a_r $  has a non-zero term.

	From this $$P(\alpha, \alpha)\,=\, a_1 + a_2 \alpha ^{\sum exp w_2} +...+ a_k \alpha ^{\sum exp w_k} =  0, \,  \, 1<k\leq r,  $$ is a non-zero polynomial with integers exponents  over $R$, for all $\alpha \in U(A)$. In the following we see that all exponents are not  necessarily positive.

	Let $\alpha ^{-l}$ be where $l=min \, \{\sum expw_i\}$, so $\alpha ^{-l}P(\alpha,\alpha)= f_0(\alpha)=0$, where $f_0\neq 0$ is a polynomial	with degree $ \leq -l + r$, over $R$. Therefore  $U(A)$ is algebraic over $R$. Now, we are going to use this polynomial with a particular unit in $U(A)$.
	First let $b=c$ be, so $a^2=b^2 =0$.
	Then we have $(1 + aua), \, (1 + bauab) \in U(A)$, for all $u \in A$.
	Let $Q_n$ be the set of all  products in $aua$ and $bauab$ with at most $n-1$ factors, and let
	$W$  be the set of all  products in coeficients $ a_i`s$, $ aua$  and $ bauab$.

	Thus $\alpha = (1 + aua).(1 + bauab) \, \in \, U(A) $, and for this unit,
	$$\alpha ^n= 1 + aua + bauab +  \sum_{t\in Q_n}t+  (auabauab)^n$$ for all $n \geq 1$.

	It follows that there exists  a polynomial $f_0\neq 0 $ over $R$ such that

\begin{eqnarray*}
f_0(\alpha) &=&  a_1 + a_2 +...+ a_r + \sum_{t\in W}t + \hspace*{0,8cm}  \sum ^r_{i=2}  a_i (auabauab)^{s_i}\\&=&\sum_{t\in W}t  +\sum ^r_{i=2} \,  a_i (auabauab) ^{s_i} =0.
\end{eqnarray*}

	As $ a_2 +...+ a_r \neq 0 $, after to organize  the   powers of $auabauab$  which appears in the last sum,  has a non-zero coefficients.  This term has the form $(a_{j_1}+...+a_{j_k})(auabauab)^s$ where $s \, \leq \, (-l + r)$. So, $abf_0(\alpha)au=0$ is a  non-zero polynomial $g$ over R such that $g(abau) = 0$ with degree $ \leq \,2( -l + r ) +1$. This finishs the  case  $b=c$.

	In general, if $a,\, \alpha ,\, \beta \in A$ and $a^{2}=\alpha \beta =0$, then  we have $(\beta u \alpha)^{2}=0 \,,$ 	for all $u \in A $. So $\beta u \alpha a \beta u \alpha A$ is algebraic and there exists $g$ over  $R$ which is not zero and

	$g( (\beta u \alpha a \beta u \alpha)a)=0$, from this there exists a non-zero polynomial $f=(\alpha a ) f_0 ( \beta u )$ with $f(\alpha a \beta u)=0$ such that $d=degree\,f \leq \, \, 4( -l + r) +3  $. Therefore $\alpha a \beta A$ is algebraic over $R$.

\newpage

\textbf{\textit {Proof of Corollary \ref{c1}} :}

	By Proposition \ref{p1}, there exists $f \in R[x]\setminus\{0\}$ with  degree  $ d \leq m = 4( -l + r ) +3$, such that $f(bac \lambda u)=0$ for all $\lambda \in R,\, u\, \in \, A$. That is, $\lambda p_1 + \lambda ^2 p_2 +...+ \lambda ^d  p_d=0$ where $p_i$ is polynomial on $ bacu $ with $p_d=b_d (bacu)^d$ . Now, by the Vandermond argument, $p_1=...=p_d=0$, so $ (bacu)^d=0$ .

The next results are LPI versions of Lema 3.2,  Lema 3.3  of \cite{LIU} and  Corolary 3  of  \cite{GJV94}. Their proofs are analogous to the  group identity case changing GI by LPI.

\begin{cor1}

	Let $A$ be a semiprime algebra over an  commutative domain $R$ with $|R|>d$. If $U(A)$ satisfies a $LPI$, then every idempotent element of $R^{-1} A$ is central.

\end{cor1}

\begin{cor1}\label{c2}

	Let $A$ be an algebra over a field $K$ with $ U(A)$ satisfying a $LPI$, and   $a,\, b \, \in A $ such that $a^2=b^2=0$.

	\begin{enumerate}

		\item If $\mid K \mid > 2d$, then $(ab)^{2d}=0.$
		\item If $ab$ is nilpotent, then $(ab)^{2d}=0.$
	\end{enumerate}

\end{cor1}

\begin{cor1}

	Let $K$ be any field and $n\geq 2$. Then the following are equivalent

	\begin{enumerate}
		\item  $U(M_n(K))$ satisfies the $LPI$.
		\item  $K$ is a finite field.
		\item  $U(M_n(K))$ satisfies a group identity.
	\end{enumerate}

In addition, if one of these conditions is hold, then

	$\mid K \mid  \leq 2d $  and
	$ n \leq 2log_{\mid K \mid}2d + 2 \leq 2log_2 2d + 2 . $

\end{cor1}

In  general,  Proposition 1.2 is not hold without the restrictions  about exponents. If it does, then $ bacu$ is algebraic for all $u \in A$, in particular, for $ c=b $ and $u=a$, $ba$ is algebraic.  It follows that by    Vandermonde augument with $R$ a infinite commutative domain $ba$ is nilpotent. In general,   $ba$ is not a nilpotent element. For example, let $A=M_n(R), \, n>1$. By $Amitsur-Levitzki$ theorem \cite{P} $A$ satisfies a $LPI$

$$ f_1(x_1,...,x_{2n})= S_{2n}\cdot(x_1\cdots x_{2n})^{-1}  $$  where $s_{2n}$ is the polynomial standard.
However $A$ with $a=e_{21}$ and $b=e_{12}$,  $ba=e_{11}$ is not nilpotent. Note that this algebra also satisfies
$$f_2(x_1,...,x_{2n})=f_1(x_1,...,x_{2n})\,+\, S_{2n}  $$ (an $LPI$ with some words having sum of exponents zero at every variable).

By the same arguments we can see that if $A= M_n(R)$ be $n>1$  and $R$ a infinite commutative domain,   there is not exist a non-zero polynomial $g\, \in \, R[X] $ not zero such that $g(ab)=0$ for all $a,\, b \in \, A $ with $a^2=b^2=0 $. Note that the other side of Proposition 1.2 is true. In fact, suppose that $R$ is finite, so $A$ is finite. From this for all  matrices  $x \in A$ there exist integers $r>t>0$ such that $x^r=x^t $. So $x$ satisfies the polynomial $p_x(X)=X^r-X^t$. Then defining $g= \displaystyle\prod_{x\in A} p_x$ one has $g(ab)=0$ for all $a,\, b \in \, A $ with $a^2=b^2=0 $, which is a contradiction.

\begin{lem1}\label{2}

	Let $A= M_n(R)$ be $n>1$  and $R$ a  commutative domain. Then $R$ is infinite if and only if there is not any non-zero polynomial $g\, \in \, R[X] $  such that $g(ab)=0$ for all $a,\, b \in \, A $ with $a^2=b^2=0 $.

\end{lem1}

\begin{prop}\label{p2}
	Let $F=\displaystyle\frac{R[x, y]}{(x^2,\, y^2)}$  where $R$ is a infinite commutative domain. Then $F$ satisfies any polynomial identity $f$ of $M_n(R)$ where $ n\geq2$. Also,  $U(F)$ does not satisfy the standard polynomial  $S_2$ and $S_3$. In particular, $F$ satisfies $S_{2n}$ if only if $n\geq 2$.

	\begin{proof}

	Suppose by contradiction that $F$ does not satisfy an identity $f$ of $M_n(R)$ where $ n\geq2$. Then there exist   $\overline{u_1}=\overline{ g_1(x,y)},...,\overline{u_{2n}}=\overline{g_{2n}(x,y)} \, \in \, F$  with
		$$ f(\overline{u_1},...,\overline{u_{2n}})\neq 0 .$$ So (multiplying by $x$ or $y$ on left or right if necessary) we obtain  $$g(xy) = f(u_1,...,u_{2n})\neq \sum_{i}f_iu^2g_i, $$ $u=x,\, y$. Then, for all   $a,b\, \in \, A= M_n(R)$ such that $a^2=b^2=0$, we have  $ g(ab) = 0 $  it is a contradiction by  Lemma \ref{2}. By evaluation of $S_2$ and $S_3$ on  units $\overline {1+x},\, \overline { 1 + y}$ and $\overline{(1 +x)(1+y)}$, we see that $U(F)$ does not satisfy $S_2$ and $S_3.$

	\end{proof}

\end{prop}

\begin{cor1}

	Let $B$	be an algebra over a commutative domain $R$ whose $U(A)$ satisfies the standard polynomial  $S_3$. Then there exists a polynomial $g \in R[X]$ such that $g(ab)=0$ for all $a,\,b \in B$ with $a^2=b^2=0.$

\end{cor1}

\begin{proof}

By applying  $S_3$ on  $X, Y$ and $XY$ we obtain $$S_3(X,\, Y, \, XY)= (YX)^2 -X^2Y^2 - YX^2Y + XY^2X.$$ So $S_3(1 +x, 1+y, (1+x)(1+y))\neq 0 $ in $F$, then  multiplying by $x$ on the left and  $y$ on the right  we obtain a polynomial $g(xy)=xS_3y$ such that $g(ab)= 0.$

\end{proof}

\begin{cor1}

	Let  $F$ be the algebra in Proposition \ref{p2}. The $F$ does not satisfy the group identity $w=1$, with $R$ a infinite field.
\end{cor1}

\begin{proof}

	If $F$ satisfies a group identity $w=1$. By Lemma 3.1 \cite{LIU} there exists a polynomial $g(t) \in R[t] $ such that $g(\overline{x}\,\overline{y})=0$. Thus $\overline{g(xy)}=0$, that is, $g(xy)=\sum f_iu^2g_i, \, u=x,\, y$. Then, $g(ab)=0$ for all $a,b \in M_n(R)$ such that $a^2=b^2=0$ and this contradicts Lemma 1.1.

\end{proof}

With some adaptations Lemma 3.1 \cite{LIU} holds whenever $R$ is  an infinite commutative domain. It follows that Corollary \ref{c2} holds if $R$ is an infinite commutative domain.
Note that $F$ is an algebra with $LPI$ ( having more than one word which  not constant) with $\sum \, exp w_i =0$  without group identity ($LPI$ with only one non-constant word).

\newpage

\printindex


\section{Abstract}

In previous works we considered schematic Hamiltonians represented
by simplified matrices. We defined 2 transition operators and calculated
transition strengths from the ground state to all exited states.In
many cases the strengths decreased nearly exponentially with excitation
energy. Now we do the reverse We start with the highest energy state
and calculate the cascade of transitions until the ground states is
reached.On a log plot we show the average transition strength as a
function of the number of energy intervals that were crossed. We give
an analytic proof of exponential behavior for transition strength
in the weak coupling limit for the T$_2$ transition operator.

\section{Introduction}

In ref {[}1{]} and {[}2{{]} }A.Kingan et al. calculated M1 transition
from the lowest J=1+ state of a selected even-even nucleus to excited
states. In the first work they emphasized strong transitions to individual
states.. Although transitions to the ground state were large (inverted
scissors) there were many other transition strengths that were even
larger i.e to other J=0+ states and to many J=2+states. Basically
they were calculating double magnetic dipole strength.

In Ref {[}2{]} transitions to nearly all states we're considered-strong
or weak. A wide spread of results was noted. However when the transition
strengths in certain energy intervals (bins)were summed up one saw
an exponential decrease in strength with excitation energy. Coincidentally
a similar behavior, exponential decrease with excitation energy, was
also found in a different problem - a study of schematic matrix hamiltonians
for their own sake{[}3,4,5{]}.The study was mainly on tridiagonal
matrices{[}3,4{]} but also later pentadiagonal were considered{[}5{]}.
We will here consider also heptadiagonal matrices.

We were informed about experiments and calculations which do the opposite
of what we have done-start with the highest level and calculate all
transition strengths as the nucleus deexcites emitting gamma rays
{[}6-11{]}. They plot the average M1 strength versus gamma ray energy. They find a strong increase in average
M1 strength as one goes to low gamma ray energies.

We will here also do such calculations with our schematic Hamiltonian
matrices. Because they are simpler perhaps we can cast some light
on what is causing the behaviors that have been observed. Indeed in
ref {[}5{]} we were able to get some analytic results for wave functions
and transitions from the ground state, especially in the weak coupling
limit. in contrast to [6] and [8-12] we present our results as log plots. Brown and Larsen also used a
log plot [7]. It should be made clear that our basic aim is to study the properties
of the matrix Hamiltonian of Table 1. We will not attempt to fit the
results of {[}6-12{]} but we will see if there are some common features
that might be of interest.

In a previous work [5] with tridiagonal matrices it was shown that in the weak coupling limit
the ground state column vector (a$_0$,a$_1$...a$_n$....) was such that a$_n$=$(\frac{-v}{E})^n \frac{1}{n!} $. We recognized
this as an a expansions in a Taylor series of e$^{-\frac{v}{E}} $. The $\frac{1}{n!} $ terms come from energy
denominators in the wave function

$\Psi$= $\varPhi$ + $\frac{1}{E_0-H_0} $QV$\varPsi$ = (1+$\frac{1}{E_0-H_0} $QV +$\frac{1}{E_0-H_0} $QV$\frac{1}{E_0-H_0} $QV+..... )$\varPhi$

\section{The Calculation.}

We here show a 11 by 11 Hepta diagonal matrix we will be working with.
We can also get results for tri and penta diagonal matrices by setting
certain parameters to zero.

\begin{table}[H]
\captionof{table}{The septa- diagonal matrix} %
\begin{tabular}{|c|c|c|c|c|c|c|c|c|c|c|}
\hline
0  & v  & w  & x  &  &  &  &  &  &  & \tabularnewline
\hline
v  & E  & v  & w  & x  &  &  &  &  &  & \tabularnewline
\hline
w  & v  & 2E$ $  & v  & w  & x  &  &  &  &  & \tabularnewline
\hline
x  & w  & v  & 3E  & v  & w  & x  &  &  &  & \tabularnewline
\hline
 & x  & w  & v  & 4E  & v  & w  & x  &  &  & \tabularnewline
\hline
 &  & x  & w  & v  & 5E  & v  & w  & x  &  & \tabularnewline
\hline
 &  &  & x  & w  & v  & 6E  & v  & w  & x  & \tabularnewline
\hline
 &  &  &  & x  & w  & v  & 7E  & v  & w  & x\tabularnewline
\hline
 &  &  &  &  & x  & w  & v  & 8E  & v  & w\tabularnewline
\hline
 &  &  &  &  &  & x  & w  & v  & 9E  & v\tabularnewline
\hline
 &  &  &  &  &  &  & x  & w  & v  & 10E\tabularnewline
\hline
\end{tabular}
\end{table}

We will be considering and comparing results for tridiagonal, pentadiagonal
and heptadiagonal matrix Hamiltoninans. For tridiagonal case, we set
x=0, w=0 and for the pentadiagonal case, x=0 in the matrix shown in
Table 1. In previous works {[}3,4,5{]} we defined 2 types of transition
operators \textless{}n T$_1$(n+1)\textgreater{}= 1 and \textless{} n
T$_2$ (n+1) \textgreater{} = $\sqrt{n+1}$. In this work we will only
show results for the latter.

\section{The Figures}

We here present several figures. We only include the T$_2$ coupling case.
We show side by side figures of the cascade down average strength
(left) and the transition strength up (right). This is done first
for the tridiagonal case with v=0.01, 0.1 and 1. Next for the petadiagonal
case w=v(0.01, 0.1). Next heptadiagonal with v=w=x(0.01, 0.1, 1) and
then again heptadiagonal w=$\frac{v}{2\!}$,x=$\frac{v}{3\!}$ (v=0.01,
0.1 and 1). Note that although not identical the cascade (down) figures
look very similar to the corresponding excitation (up) figures.

\begin{center}

\begin{figure}[!htbp]
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig1.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig2.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig3.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig4.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig5.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig6.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig7.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig8.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig9.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig10.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig11.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig12.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig13.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig14.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig15.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig16.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig17.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig18.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig19.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig20.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig21.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig22.png}}{}
\caption*{}
\end{figure}

\end{center}

\begin{center}

\begin{figure}[!htbp]%
\footnotesize
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig23.png}}{ }%
\hspace{1cm}%
\stackunder[5pt]{\includegraphics[width=6cm,height=3.66cm]{fig24.png}}{}
\caption*{}
\end{figure}

\end{center}

\section{Discussion}

We have put the cascade and excition figures side by side to make
the point that , although not identical, they are remarkably similar.
We emphasize that cascade is not the reverse of excitation. In the latter we always start
with the lowest state and go to the n'th excited state. In cascade we have many other
(reverse) transitions e.g. from the eighth excited state to the fifth one.
We first consider the tridiagonal case. One gets the best linear behavior for
v/E=0.1.Linearity on a log plot implies exponential behavior. For v/E=1 the curve is
dominantly linear but there is a slight arch. Surprisingly for v=0.01, there is a kink at n=9.
We will later see that this is not the case for asymptotically small v/E.
In the pentadiagonal case for transition strength for v=1 there is a large dip at n=2-
destructive interference. It is present but less pronounced in the cascade case; also
present but less pronounced for smaller v/E.
For the heptadiagonal transition case with v=w=x=1 we also get a pronounced dip
but at n=3. In the cascade case there is linear behavior from n=4 onward but the curve
flattens out for n= 4, 3, and 2 but here is then a significant rise for n=1. However when,
again for the heptadiagonal case we set v=1, w=$\frac{1}{2!}$, x=$\frac{1}{3!}$ the cascade curve looks quite linear again. This is not a complete surprise because when we make w and x smaller, we go in the direction of the tridiagonal result.
In Tables 2, 3 and 4 we show the excitation strengths for v=0.01, 0.1 and in tables
5, 6, and 7 the corresponding cascade averages. In contrast to the figures we here
show side by side the tri,penta and hepta diagonal results for a given v.

\begin{center}
\begin{table}[H]
\captionof{table}{Excitation Spectrum for v=1} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & -0.17879  & -1.09417  & -0.3195  & -0.41621 \tabularnewline
\hline
2  & -4.93803  & -6.83181  & -1.71336  & -4.11011 \tabularnewline
\hline
3  & -7.07651  & -2.52695  & -4.92044  & -4.37961 \tabularnewline
\hline
4  & -9.88843  & -4.66744  & -2.33968  & -4.94979 \tabularnewline
\hline
5  & -13.1961  & -5.62655  & -3.85475  & -6.69694 \tabularnewline
\hline
6  & -16.8808  & -7.32741  & -4.78282  & -8.36112 \tabularnewline
\hline
7  & -20.8785  & -8.8552  & -5.72363  & -10.1684 \tabularnewline
\hline
8  & -25.2209  & -11.1213  & -6.80623  & -12.1534 \tabularnewline
\hline
9  & -30.338  & -12.9337  & -7.35953  & -14.1213 \tabularnewline
\hline
10  & -36.6644  & -16.4684  & -10.2962  & -17.9763 \tabularnewline
\hline
\end{tabular}
\end{table}

\par\end{center}

\begin{center}
\begin{table}[H]
\captionof{table}{Excitation Spectrum for v=0.1} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & -0.00738  & -0.14681  & -0.12787  & -0.14681 \tabularnewline
\hline
2  & -6.41019  & -6.7705  & -4.84763  & -6.7705 \tabularnewline
\hline
3  & -15.2755  & -6.55817  & -6.75191  & -6.55817 \tabularnewline
\hline
4  & -23.5227  & -14.13  & -6.68711  & -14.13 \tabularnewline
\hline
5  & -31.8735  & -16.099  & -12.7848  & -16.099 \tabularnewline
\hline
6  & -40.4297  & -22.4111  & -14.9645  & -22.4111 \tabularnewline
\hline
7  & -49.2041  & -25.2178  & -16.6326  & -25.2178 \tabularnewline
\hline
8  & -58.1883  & -31.1712  & -21.4201  & -31.1712 \tabularnewline
\hline
9  & -67.3691  & -34.5585  & -23.8361  & -34.5585 \tabularnewline
\hline
10  & -76.7596  & -39.6674  & -25.5686  & -39.6674 \tabularnewline
\hline
\end{tabular}
\end{table}

\par\end{center}

\begin{center}
\begin{table}[H]
\captionof{table}{Excitation Spectrum for v=0.01} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & -7.6E-05  & -0.01423  & -0.01404  & -0.07396 \tabularnewline
\hline
2  & -10.9735  & -11.009  & -9.24842  & -6.13671 \tabularnewline
\hline
3  & -24.486  & -11.2124  & -11.2329  & -8.00813 \tabularnewline
\hline
4  & -37.3515  & -23.6196  & -11.3943  & -10.221 \tabularnewline
\hline
5  & -50.3143  & -25.5145  & -22.2603  & -16.9359 \tabularnewline
\hline
6  & -63.4797  & -36.5333  & -24.4962  & -19.9302 \tabularnewline
\hline
7  & -76.8619  & -39.3634  & -26.2338  & -23.4957 \tabularnewline
\hline
8  & -90.4727  & -49.9249  & -35.549  & -28.6644 \tabularnewline
\hline
9  & -94.8711  & -53.4074  & -38.0957  & -32.2198 \tabularnewline
\hline
10  & -118.209  & -63.6203  & -40.5783  & -36.1814 \tabularnewline
\hline
\end{tabular}
\end{table}

\par\end{center}

In Table 5-7 we show results for the cascade decays.

\begin{table}[H]
\captionof{table}{Cascade Decays for v=1} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & 1.475208  & 1.375723  & 1.33565  & 1.419713 \tabularnewline
\hline
2  & -2.97858  & -2.28142  & -2.12546  & -1.07107 \tabularnewline
\hline
3  & -7.35646  & -2.92052  & -2.91908  & -4.28074 \tabularnewline
\hline
4  & -10.701  & -5.31517  & -2.782  & -5.81003 \tabularnewline
\hline
5  & -14.253  & -6.98987  & -4.42519  & -7.94482 \tabularnewline
\hline
6  & -17.9651  & -8.33056  & -5.80058  & -9.54138 \tabularnewline
\hline
7  & -21.9022  & -9.99003  & -6.65594  & -11.2324 \tabularnewline
\hline
8  & -26.0397  & -12.055  & -7.46434  & -13.0221 \tabularnewline
\hline
9  & -30.8862  & -13.58  & -7.90574  & -14.7925 \tabularnewline
\hline
10  & -36.6644  & -16.4684  & -10.2962  & -17.9763 \tabularnewline
\hline
\end{tabular}
\end{table}

\begin{table}[H]
\captionof{table}{Cascade Decays for v=0.1} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & 1.700507  & 1.699669  & 1.698715  & 1.700062 \tabularnewline
\hline
2  & -7.36563  & -7.41067  & -5.80332  & -7.1114 \tabularnewline
\hline
3  & -16.9479  & -7.37501  & -7.3255  & -8.75926 \tabularnewline
\hline
4  & -25.274  & -15.6679  & -7.37551  & -11.0702 \tabularnewline
\hline
5  & -33.555  & -17.4211  & -13.6674  & -18.3371 \tabularnewline
\hline
6  & -41.9662  & -23.6271  & -16.0857  & -21.1241 \tabularnewline
\hline
7  & -50.5406  & -26.2587  & -17.5985  & -24.4477 \tabularnewline
\hline
8  & -59.2485  & -32.1169  & -22.3293  & -29.4771 \tabularnewline
\hline
9  & -68.0405  & -35.2084  & -23.7897  & -32.5574 \tabularnewline
\hline
10  & -76.7596  & -39.6674  & -25.5686  & -36.1814 \tabularnewline
\hline
\end{tabular}
\end{table}

\begin{table}[H]
\captionof{table}{Cascade Decays for v=0.01} %
\begin{tabular}{|l|l|l|l|l|}
\hline
 & tri  & penta  & hepta  & hepta vwx \tabularnewline
\hline
1  & 1.704704  & 1.704701  & 1.704698  & 1.704703 \tabularnewline
\hline
2  & -11.9639  & -11.969  & -10.2798  & -11.738 \tabularnewline
\hline
3  & -26.1929  & -12.0361  & -12.0326  & -13.491 \tabularnewline
\hline
4  & -39.1037  & -25.0972  & -12.081  & -15.6637 \tabularnewline
\hline
5  & -51.9939  & -26.7729  & -22.833  & -27.57 \tabularnewline
\hline
6  & -65.0163  & -37.8633  & -25.5572  & -30.5178 \tabularnewline
\hline
7  & -78.1967  & -40.4355  & -27.0735  & -34.2006 \tabularnewline
\hline
8  & -79.6778  & -50.8625  & -36.0801  & -43.6991 \tabularnewline
\hline
9  & -89.5096  & -53.9601  & -38.4745  & -47.0518 \tabularnewline
\hline
10  & -118.209  & -63.6203  & -40.5783  & -51.3127 \tabularnewline
\hline
\end{tabular}
\end{table}

\section{Weak Coupling Limit for a Tridiagonal Matrix with T$_{2}$ Transition
Operator}

We can show that with T$_2$ tranistion operator \textless{}n T$_{2}$
(n+1)\textgreater{} = $\sqrt{n+1}$

in the weak coupling limit $u=\frac{v}{E}$ is very small

O(0 $\rightarrow$ n) has the structure $(\frac{v}{E})^{(n-1)}$ A$_{n}$
where A$_{n}$ does not depend on v/E.

ln (O$^{2}$)= (n-1) ln($(\frac{v}{E})^{2}$) +ln (A$_{n}^{2}$) in
the weak coupling limit

Note that by making $\frac{v}{E}$ very small ln(($\frac{v}{E}$) $^{2}$)
becomes very large and negative thus drowning out the term ln (A$_{n}^{2}$).
Thus we get ln($O^{2}$) approaches (n-1) ln($(\frac{v}{E})^{2}$).
The fact that this ln($O^{2}$) is linear in (n-1) proves that we
have exponential behavior for $O^{2}$. In a previous work {[}5?{]}
we considered the weak coupling limit for the transition operator
T$_1$. In that case O(1 $\rightarrow$ n) was of the $(\frac{v}{E})^{m}$
A(1 $\rightarrow$ n). However m was not the same as (n-1) so there
was no exponential behavior for T$_1$. As shown in ref {[}5{]} the values
of m from 1 to 9 are respectively 0, 3, 4, 5, 6, 5, 6, 7, 8. For n=10
the value of O is zero (ln($O^2$) = $- \infty$).

\captionof{table}{T2 Transition Strength, $\frac{v}{E}=0.0001$} %
\begin{tabular}{|c|c|c|c|c|}
\hline
0$\rightarrow n$  & ln (A$_{n}^{2}$)  & (n-1) ln ($(\frac{v}{E})^{2}$)  & sum &Exact\tabularnewline
\hline
1  & 0  & 0  & 0&0\tabularnewline
\hline
2  & -1.7627  & -18.42  & -20.1034&-20.18\tabularnewline
\hline
3  & -6.0653  & -36.84  & -42.9060&-42.91\tabularnewline
\hline
4  & -9.7206  & -55.26  & -64.9827&-64.92\tabularnewline
\hline
5  & -13.4731  & -73.68  & -87.1558&-87.16\tabularnewline
\hline
6  & -9.5394  & -92.103  & -101.6340&-101.63\tabularnewline
\hline
7  & -9.1366  & -110.52  & -119.6610&-119.36\tabularnewline
\hline
8  & -10.4230  & --128.945  & -139.368&-139.36\tabularnewline
\hline
9  & -12.6063  & -147.37  & -159.972&-159.97\tabularnewline
\hline
10  & -35.3138  & -165.79  & -201.102&-201.1\tabularnewline
\hline
\end{tabular}%

For the T$_2$ transition operator the expressions for A$_n$ are given in
Table 10 in terms of g$_k$=$\frac{1}{k!}$

\pagebreak

\captionof{table}{T1 Transition Strength, $\frac{v}{E}=0.0001$}
\begin{tabular}{|c|c|c|c|c|c|}
\hline
n & m & ln(A$_{n}^{2}$) & ln($\frac{v}{E}$)$^{m}$ & Sum & Exact\tabularnewline
\hline
1 & 0 & 0 & 0 & 0 & 0\tabularnewline
\hline
2 & 3 & -0.8109 & -55.2620 & -56.07 & -57.46\tabularnewline
\hline
3 & 4 & -4.1589 & -73.6827 & -77.84 & -80.04\tabularnewline
\hline
4 & 5 & -5.9915 & -92.1034 & -98.09 & -102.48\tabularnewline
\hline
5 & 6 & -8.3627 & -110.5240 & -118.89 & -116.49\tabularnewline
\hline
6 & 5 & -9.5750 & -92.1034 & -101.67 & -101.62\tabularnewline
\hline
7 & 6 & -9.9396 & -110.5241 & -120.46 & -120.46\tabularnewline
\hline
8 & 7 & -11.6342 & -128.944 & -140.46 & -140.58\tabularnewline
\hline
9 & 8 & -14.0985 & -147.3654 & -161.46 & -161.46\tabularnewline
\hline
10 &  &  &  &  & $-\infty$ \tabularnewline
\hline
\end{tabular}

\captionof{table}{ Expressions for A$_{n}$ for T$_2$ transition
operator g$_{k}$=$\frac{1}{k!}$ .}
\begin{table}[H]
\begin{tabular}{|l|l|}
\hline
A$_{n}$ & expression in terms of g$_k$ \tabularnewline
\hline
1  & 1 \tabularnewline
\hline
2  & 1-$\sqrt{2}$\tabularnewline
\hline
3  & g$_2$-$\sqrt{2}$+g$_2${*}$\sqrt{3}$ \tabularnewline
\hline
4  & g$_3$-g$_2${*}$\sqrt{2}$+g$_2${*}$\sqrt{3}$-g$_3${*}$\sqrt{4}$ \tabularnewline
\hline
5  & g$_4$-g$_3${*}$\sqrt{2}$+g$_2${*}g$_2${*}$\sqrt{3}$-g$_3${*}$\sqrt{4}$+g$_4${*}$\sqrt{5}$\tabularnewline
\hline
6  & -g$_4${*}$\sqrt{2}$+g$_2${*}g$_3${*}($\sqrt{3}$-$\sqrt{4}$)+g$_4${*}$\sqrt{5}$-g$_5${*}$\sqrt{6}$\tabularnewline
\hline
7  & g$_2${*}g$_4${*}$\sqrt{3}$-g$_3${*}g$_3${*}$\sqrt{4}$+g$_4${*}g$_2${*}$\sqrt{5}$-g$_5${*}$\sqrt{6}$+g$_6${*}$\sqrt{7}$\tabularnewline
\hline
8  & g$_4${*}g$_3${*}($\sqrt{5}$-$\sqrt{4}$)-g$_2${*}g$_5${*}$\sqrt{6}$ +g$_6${*}$\sqrt{7}$-g$_7${*}$\sqrt{8}$\tabularnewline
\hline
9  & %
\begin{tabular}{@{}l@{}}
g$_4${*}g$_4${*}$\sqrt{5}$-g$_5${*}g$_3${*}$\sqrt{6}$+g$_6${*}g$_2${*}$\sqrt{7}$-g$_7${*}$\sqrt{8}$+g$_8${*}$\sqrt{9}$\tabularnewline
\end{tabular}\tabularnewline
\hline
10 & g$_9$-g$_8${*}$\sqrt{2}$+g$_2${*}g$_7${*}$\sqrt{3}$-g$_6${*}g$_3${*}$\sqrt{4}$+g$_4${*}g$_5${*}$\sqrt{5}$-g$_4${*}g$_5${*}$\sqrt{6}$+g$_6${*}g$_3${*}$\sqrt{7}$-g$_7${*}g$_2${*}$\sqrt{8}$+g$_8${*}$\sqrt{9}$-g$_9${*}$\sqrt{10}$ \tabularnewline
\hline
\end{tabular}
\end{table}

In the (n,$\gamma$) results the best example of a linear behavior on a log plot is given
in Fig 1 of Brown and Larsen [7]. Of course the Hamiltonian they use is completely
different from the simple one used here, but it suggests that the phenomenon of
exponential behavior is more widespread than one might initially think. We have given
support to this notion by proving that one gets exponential behavior in the weak
coupling limit.


\section{Conclusion and Future Work}
\label{sec:conclusion}

This paper was dedicated to make neural networks FAIR. To this end, we first proposed the \textsc{FAIRnets Ontology}, an ontology that allows us to model neural networks on a fine-grained level and that is easily extensible. Second, we provided the knowledge graph \textsc{FAIRnets}. This graph contains rich metadata of 18,463 publicly available neural network models using our proposed ontology as knowledge schema. Both the \textsc{FAIRnets Ontology} as well as the \textsc{FAIRnets} knowledge graph show a high potential impact in fields like recommender systems and education.

For the future, we plan to connect the \textsc{FAIRnets Ontology} and \textsc{knowledge graph} with scholarly data. Specifically, we will work on linking publications, authors, and venues modeled in knowledge graphs like the Microsoft Academic Knowledge Graph~\cite{Farber19} or Wikidata to the \textsc{FAIRnets} knowledge graph. This will require to apply sophisticated information extraction methods on scientific publications.

\section{FAIR Principles for Neural Networks}
\label{sec:fair}

\begin{table*}[tbp]\centering
\caption{Evaluation of \textsc{FAIRnets} according to the Generation2 FAIRMetrics (Note: \ding{51} = passed, (\ding{51})= should pass, \ding{55} = not passed).}
\label{tab:fairmetrics}
\begin{small}
\begin{tabular}{@{}lp{2.5cm}p{6.5cm}cp{1cm}@{}}\toprule
Principle & FAIRMetric & Name & Result \\ \midrule
\multirow{5}{*}{Findable} & \textit{Gen2\_FM\_F1A} & Identifier Uniqueness & \ding{51} \\
& \textit{Gen2\_FM\_F1B} & Identifier persistence & \ding{51} \\
& \textit{Gen2\_FM\_F2} & Machine-readability of metadata & \ding{51} \\
& \textit{Gen2\_FM\_F3} & Resource Identifier in Metadata & \ding{51} \\
& \textit{Gen2\_FM\_F4} & Indexed in a searchable resource & \ding{55} \\
\midrule
\multirow{4}{*}{Accessible} & \textit{Gen2\_FM\_A1.1} & Access Protocol & \ding{51} \\
& \textit{Gen2\_FM\_A1.2} & Access authorization & \ding{51} \\
& \textit{Gen2\_FM\_A2} & Metadata Longevity & (\ding{51})  \\
\midrule
\multirow{3}{*}{Interoperable} & \textit{Gen2\_FM\_I1} & Use a Knowledge Representation Language & \ding{51} \\
& \textit{Gen2\_FM\_I2} & Use FAIR Vocabularies & \ding{51} \\
& \textit{Gen2\_FM\_I3} & Use Qualified References & \ding{51} \\
\midrule
\multirow{3}{*}{Reusable} & \textit{Gen2\_FM\_R1.1} & Accessible Usage License & \ding{51} \\
& \textit{Gen2\_FM\_R1.2} & Detailed Provenance & (\ding{51}) \\
& \textit{Gen2\_FM\_R1.3} & Meets Community Standards & (\ding{51}) \\
\bottomrule
\end{tabular}
\end{small}
\end{table*}

With \textsc{FAIRnets}, we treat neural networks as research data. As such, to ensure good scientific practice, it should be provided according to the FAIR principles, that is, the data should be findable, accessible, interoperable, and reusable.
While the GitHub repositories themselves do not satisfy the FAIR principles (e.g., the metadata is not easily searchable and processable by machines), the modeling of the neural networks in the \textsc{FAIRnets} knowledge graph is made \textit{FAIR} as we show in the following.
Specifically, in this section, we identify the factors that make the neural network representations in \textsc{FAIRnets} \textit{FAIR}. This was achieved by following the \textit{FAIRification process}.\footnote{\url{https://www.go-fair.org/fair-principles/fairification-process/}, last acc. 2020-10-15.}
Our FAIRification process is aligned with the \textit{FAIRMetrics}\footnote{\url{https://fairmetrics.org}, last acc. 2020-10-15} outlined in Tab.~\ref{tab:fairmetrics}. In the following, we point out how the single FAIR metrics are met by our knowledge graph.

\noindent\textbf{Findable}
describes the property that metadata for digital assets is easy for both humans and machines to find.
Our approach ensured that, firstly, by retrieving the metadata available in the repository, secondly, structuring its metadata in the readme file, and thirdly, obtaining the architecture information from the code file according to the \textsc{FAIRnets Ontology}. The neural networks we model have unique identifiers (i.e., fulfilling \textit{Gen2\_FM\_F1A}) and a persistent URI (\textit{Gen2\_FM\_F1B}).
As a result, the process for a human to find a suitable neural network through resource identifiers in the metadata (\textit{Gen2\_FM\_F3}) is improved.
By using RDF as the data model and by providing a schema in OWL as well as a VoID file as a description of the knowledge graph, the metadata is machine-readable (\textit{Gen2\_FM\_F2}). Thus, the knowledge graph can be automatically filtered and used by services. An exemplary service supporting this statement is presented in Sec.~\ref{FAIRnetsSearch}.
\textsc{FAIRnets} allows for querying information about and within the architecture of the neural networks which was not possible previously. Now, complex queries are feasible (e.g., list all recurrent neural networks published in 2018), which cannot be solved by traditional keyword searches.
The metric \textit{Gen2\_FM\_F4}\footnote{\url{https://github.com/FAIRMetrics/Metrics/blob/master/FM_F4}, last acc. 2020-10-15} -- `indexed in a searchable resource' -- was not passed by \textsc{FAIRnets} although we indexed it on Zenodo. The reason is that the resource on Zenodo is not findable in the search engine Bing which the authors of the FAIRMetrics use as ground truth. However, \textsc{FAIRnets} is indexed by the search engine Google.

\noindent\textbf{Accessible}
describes that users can access (meta)data using a standardized communication protocol. The protocol must be open, free, and universally implemented. \textsc{FAIRnets Ontology and knowledge graph} is located on a web server and can be accessed using the HTTPS protocol (\textit{Gen2\_FM\_A1.1}). The neural networks in the repositories can also be accessed using the HTTPS protocol (\textit{Gen2\_FM\_A1.2}).
In addition to the open protocol, the accessible property requires that metadata can be retrieved, even if the actual digital assets are no longer available. Due to the separation of the information in \textsc{FAIRnets} and the actual neural networks on GitHub, this property is fulfilled, since the information in \textsc{FAIRnets} is preserved even if the neural networks on GitHub are no longer available (\textit{Gen2\_FM\_A2}).
The service to evaluate the metric \textit{Gen2\_FM\_A2} -- `metadata longevity' -- could not be executed because it only tests files that are less than 300kb\footnote{\url{https://github.com/FAIRMetrics/Metrics/blob/master/FM_A2}, last acc. 2020-10-15} whereas \textsc{FAIRnets} has more than 80MB. This test checks for the existence of the `persistence policy' predicate. This predicate is available in \textsc{FAIRnets}, which should pass the test.

\noindent\textbf{Interoperable}
refers to the capability of being integrated with other data as well as being available to applications for analysis, storage, and further processing.
We make use of Linked Data by applying RDF (\textit{Gen2\_FM\_I1}) and SPARQL to represent the information. This makes the data machine-readable, even without the specification of an ad-hoc algorithm or mapping. Additionally, the \textsc{FAIRnets Ontology} and the respective \textsc{knowledge graph} use well-established and commonly used vocabularies to represent the information. Among others, Dublin Core, Vocabulary of a Friend (VOAF), Creative Commons (CC), and a vocabulary for annotating vocabulary descriptions (VANN) are used for annotations and descriptions (\textit{Gen2\_FM\_I2}).
As a further requirement of the FAIR guideline, qualified references to further metadata are required. This requirement is fulfilled by \texttt{rdfs:seeAlso} and \texttt{dc:references} (\textit{Gen2\_FM\_I3}). \texttt{dc:references} statements provide scientific references between the neural networks and scientific contributions. These references to the scientific contributions are provided via globally unique and persistent identifiers, such as DOIs.

\noindent\textbf{Reusable}
aims at achieving well-defined digital assets. This facilitates the replicability and usage in other contexts (i.e., reproducibility), as well as findability.
Due to the architecture and metadata extraction, the process of finding and reusing a neural network by an end-user becomes significantly easier and can now be performed systematically. By using best practices in ontology building, the properties and classes of \textsc{FAIRnets Ontology} provided are self-explanatory with labels and descriptions (\textit{Gen2\_FM\_R1.3}). The neural networks in \textsc{FAIRnets} contain structured detailed metadata such as creator and GitHub link (see \textit{Gen2\_FM\_R1.2}) for easy findability and reuse. At the same time, most neural networks in \textsc{FAIRnets} have an assigned license which is important for reusability (\textit{Gen2\_FM\_R1.1}).
For passing \textit{Gen2\_FM\_R1.2}, (meta)data must be associated with detailed provenance reusing existing vocabularies such as Dublin Core which we included in our knowledge graph. \textit{Gen2\_FM\_R1.3} tests a certification saying that the resource is compliant with a minimum of metadata. \textsc{FAIRnets} is described by using LOV standards for publication. Therefore, we assume that these metrics are fulfilled.
Overall, the neural networks modeled in \textsc{FAIRnets} fulfill all requirements of the FAIR principles, see Tab.~\ref{tab:fairmetrics}.

\section{Impact}\label{sec:impact}

We see high potential of \textsc{FAIRnets Ontology} and the knowledge graph \textsc{FAIRnets} in the areas of \textit{transparency}, \textit{recommendation}, \textit{reusability}, \textit{education}, and \textit{search}.
In the following, we outline these application areas in more detail.

\paragraph{Transparency.} Neural networks are applied in many different areas such as finance \cite{QiJLQ20}, medical health \cite{khan2001}, and law \cite{PALOCSAY2000271}. Transparency plays a major role in these areas when it comes to trust the output of a used neural network model. We claim that our contribution which makes neural networks more transparent can increase trust and privacy \cite{Schwabe19}. Additionally, using semantic annotations can even enhance interpretability by distributional semantics \cite{Silva2019}.

Another aspect is the transparency of scientific work regarding neural networks. Researchers publishing a model should provide it according to the FAIR principles to strengthen their scientific contribution. Our knowledge graph \textsc{FAIRnets} can pave the way for this.

\paragraph{Recommendation.}
Neural Architecture Search (NAS) is used to find the best suitable neural network architecture based on existing architectures \cite{ElskenMH19}. However, the search is performed purely based on metrics like accuracy ignoring explainability aspects concerning the best fitting model. Our knowledge graph allows us to have a search for the best suitable neural network models on a meta-level, using modeled use-cases, data sets, and scientific papers.
Knowledge graphs have also been used to provide explanations for recommendation to the user \cite{Wang00LC19,XianFMMZ19}.

Additionally, we can apply explainable reasoning \cite{WangWX00C19} given the ontology and the knowledge graph and infer some rules. Doing this, we might reason which neural network models are reasonable or which components of the architecture stand in conflict with each other.

\paragraph{Reusability.}
Transfer learning is a method in deep learning to reuse pre-trained models on new tasks. Our contribution facilitate the search of pre-trained neural networks and provide metadata needed to choose a specific neural network.
We can envision \textsc{FAIRnets} linked with other knowledge bases to enrich reusability of neural networks by applying Linked Data Principles.\textsuperscript{\ref{linkeddata}} For example, training data sets can be linked with Neural Data Server,\footnote{\url{http://aidemos.cs.toronto.edu/nds/}, last acc. 2020-10-15} Wikidata,\footnote{\url{https://www.wikidata.org}, last acc. 2020-10-15} and Zenodo\footnote{\url{https://zenodo.org}, last acc. 2020-10-15} through schema.org,\footnote{\url{https://schema.org}, last acc. 2020-10-15} scientific papers can be linked with the Microsoft Academic Knowledge Graph \cite{Farber19}, and metadata can be extended with OpenAIRE.\footnote{\url{https://www.openaire.eu}, last acc. 2020-10-15}

On the other hand, providing a model and encouraging its reuse can improve it by revealing limitations, errors, or suggestions to other tasks.

\paragraph{Education.}
Our \textsc{FAIRnets} knowledge graph can be used for educational purposes \cite{ChenLZCY18}, for instance, to learn best practices regarding designing a neural network model. Another aspect is to learn the usages of different architectures and their approaches (e.g., via linked papers). Our knowledge graph includes training parameters that can help setting up the training process of a neural network (e.g., when facing the cold start problem).

\label{FAIRnetsSearch}
\paragraph{Search}
We provide online the search system \textsc{FAIRnets Search}\footnote{\url{https://km.aifb.kit.edu/services/fairnets/}, last acc. 2020-10-15}~\cite{NguyenW19}, which is based on the proposed \textsc{FAIRnets Ontology} and \textsc{knowledge graph}.
Users can search for neural network models through search terms.
Additional information can be retrieved by using SPARQL as query language on top of our knowledge graph, which enables faceted and semantic search capabilities. The SPARQL endpoint is also available to the public.
The search system shows how a semantic search system can be realized which improved the limited capabilities of keyword searches on GitHub.
Furthermore, developers can provide their GitHub repository to run the FAIRification process on their neural networks.
Until now, we have over 550 visits to the website \textsc{FAIRnets Search} with over 4,800 page views, 1,400 searches on our website with an average duration of twelve minutes, and the maximal actions in one visit is 356.

\section{Introduction}

Researchers of various sciences and data analysts reuse but also re-train neural network models according to their needs.\footnote{\url{https://trends.google.com/trends/explore?date=all&q=transfer\%20learning}} Providing pre-trained neural network models online has the following advantages. First, as a provider, you can benefit from users improving your neural network and circulating your research. Second, as a user of an already trained neural network, you can overcome the cold start problem as well as save on training time and costs.
Furthermore, providing trained neural network models gets increasingly important in the light of the research community efforts to make research results more transparent and explainable (see FAIR principles~\cite{wilkinson_fair_2016}). As a result, more and more trained models are provided online at source code repositories such as GitHub. The models provided serve not only to reproduce the results but also to interpret them (e.g., by comparing similar neural network models).
Lastly, providing and using pre-trained models gets increasingly important via transfer learning in other domains.

To ensure the high-quality reuse of data sets and infrastructure, the \textit{FAIR Guiding Principles for scientific data management and stewardship}~\cite{wilkinson_fair_2016} have been proposed. These guidelines are designed to make digital assets \textbf{F}indable, \textbf{A}ccessible, \textbf{I}nteroperable, and \textbf{R}e-usable. They have been widely accepted by several scientific communities nowadays (e.g.,~\cite{WISE2019933}).
Making digital assets FAIR is essential to deal with a data-driven world and thus keeping pace with an increasing volume, complexity, and creation speed of data.
So far, the FAIR principles have been mainly applied when providing data sets and code \cite{WISE2019933,DevarakondaPGK19}, but not machine learning models, such as neural network models. In this paper, we bring the FAIR principles to neural networks by (1)~proposing a novel schema (i.e., ontology) which enables semantic annotations to enhance the information basis (e.g., for search and reasoning purposes) and (2)~representing a wide range of existing neural network models with this schema in a FAIR way.
As we outline in Sec.~\ref{sec:DatasetCreation}, extracting metadata from neural networks automatically is a nontrivial task due to heterogeneous code styles, dynamic coding, and varying versioning.
The key idea is that the information contained in these networks should be provided according to the FAIR principles.
This comprises several steps which not only consist of having identifiers but providing (meta)data in a machine-readable way in order to enable researchers and practitioners (e.g., data scientists) easy access to the data. We facilitate this by using semantic web technologies such as OWL and RDF/RDFS.

Overall, we provide the following contributions:
\begin{enumerate}
 \item We provide an \textit{ontology}, called \textsc{FAIRnets Ontology},
 for representing neural networks.
 It is made available using a persistent URI by w3id and registered at the platform Linked Open Vocabularies (LOV).\\
 \textbf{Ontology URI:} \url{https://w3id.org/nno/ontology}\\
 \textbf{LOV:} \url{https://lov.linkeddata.es/dataset/lov/vocabs/nno}
 \item We provide a \textit{knowledge graph}, called \textsc{FAIRnets}, representing over 18,400 publicly available neural networks, following the FAIR principles. \textsc{FAIRnets} is available using a persistent URI by w3id and is uploaded to Zenodo.\\
 \textbf{Knowledge Graph URI:} \url{https://w3id.org/nno/data}\\
 \textbf{Zenodo:} \url{https://doi.org/10.5281/zenodo.3885249}
\end{enumerate}
Our contribution is beneficial in several application areas (see Sec.~\ref{sec:impact}). For instance, we already provide an online search system called \textsc{FAIRnets Search} \cite{NguyenW19} by which users can explore and analyze neural network models.

The paper is structured as follows.
Sec.~\ref{sec:ontology} describes the structure of \textsc{FAIRnets Ontology} and Sec.~\ref{sec:search_engine} describes the knowledge graph \textsc{FAIRnets}.
Sec.~\ref{sec:fair} explains the reason why the neural networks in \textsc{FAIRnets} follow the FAIR principles.
Sec.~\ref{sec:impact} describes the impact of \textsc{FAIRnets}.
Sec.~\ref{sec:related_work} gives an overview of related work.
Lastly, the contributions are summarized.
\section{Related Work}
\label{sec:related_work}

\paragraph{Information of neural network models.}
Mitchell et al.~\cite{mitchell_model_2019} suggest which information about neural networks should be considered as relevant when modeling them. Information such as description, date of the last modification, link to papers, or other resources to further information, as well as the intended purpose of a neural network, are taken into account.
Storing such information makes the neural networks more transparent.
We follow this suggestion by defining a semantic representation which, to the best of our knowledge, does not exist for neural network models so far.

The knowledge extraction from neural networks can point out relevant features or redundancies \cite{BG1997}. We extract neural network information to build a knowledge graph to better evaluate the causal relationships between different neural network architectures.

\paragraph{Representing and provisioning neural network models.}
There exist several standards for the exchange of neural network information on the instance level.
The Predictive Model Markup Language (PMML)\footnote{\url{http://dmg.org/pmml/v4-0-1/NeuralNetwork.html}, last acc. 2020-10-15} is an XML-based standard for analytic models developed by the Data Mining Group.
PMML is currently supported by more than 30 organizations.
The Open Neural Network eXchange format (ONNX)\footnote{\url{https://onnx.ai}, last acc. 2020-10-15}
is a project by Facebook and Microsoft that converts neural networks into different frameworks.
These two formats serve as an exchange format for neural networks on instance level.
We are less interested in the exchange of formats, but rather the reusability of the neural networks on a meta-level.
Therefore, our \textsc{FAIRnets Ontology} lifts it's elements to a semantic level, i.e. to RDF/S, following a methodology for reusing ontologies~\cite{pinto_reusing_nodate} and applying the Linked Data Principles.\textsuperscript{\ref{linkeddata}}
Thus, we incorporate information on the instance and meta-level in the knowledge graph \textsc{FAIRnets}.

\paragraph{Neural network repositories.}
Many pre-trained neural networks are available online.
The well-known Keras framework offers ten pre-trained neural networks for reuse.\textsuperscript{\ref{keras}}
The Berkeley Artificial Intelligence Research Lab has a deep learning framework called Caffe Model Zoo\textsuperscript{\ref{modelzoo}} which consists of about fifty neural networks.
Wolfram Alpha has a repository with neural networks\textsuperscript{\ref{wolfram}} which consists of approximately ninety models. These pre-trained neural networks are represented in different formats making it, for instance, difficult to compare or reuse neural networks.
Besides, a larger number of neural networks can be found in code repositories such as GitHub.
These neural networks are typically coded in one of the major programming frameworks such as Keras, TensorFlow, or PyTorch.
Our approach aims to consider such neural networks and make them available as FAIR data.
\section{FAIRnets Ontology}\label{sec:ontology}

\subsection{Creation Process}
\vspace{-0.5cm}
\begin{center}
  \begin{sidewaysfigure*}
   \includegraphics[width=1.1\textwidth]{./figs/0602_nno_visualization.eps}
\caption{Visualization of \textsc{FAIRnets Ontology}.}
\label{fig:UMLClass}
\end{sidewaysfigure*}
\end{center}
The \textsc{FAIRnets Ontology} is dedicated to model metadata for neural network models on a schema level.
We developed the ontology by using Prot\'{e}g\'{e}~\cite{musen_protege_2015}.
To the best of our knowledge, there is no existing vocabulary for the specific description of neural networks. That is why several senior researchers use best practices \cite{GangemiP09} to construct the ontology. We identify researchers, especially beginners, as potential users. The use cases we envision can be found in Sec.~\ref{sec:impact}.

In addition to the consideration of the Predictive Model Markup Language (PMML) in the development of the ontology (especially in describing the architecture), findings from further work were also considered.
In particular, model cards~\cite{mitchell_model_2019} were taken into account to validate relevant concepts.
Model cards encourage transparent model reports concerning machine learning models and are used for outlining the intended use of a model.
These cards define minimal information needed to sufficiently describe a machine learning model (in our case, a neural network) that is relevant to the intended application domains. As suggested from model cards, we included model details such as person developing model, model date, model type, and licenses.

\paragraph{Characteristics.} The structure of the \textsc{FAIRnets Ontology} can be seen in Fig.~\ref{fig:UMLClass}. Overall, the ontology consists of a total of 516 axioms and uses a total of 77 classes where 70 are sub-classes. It also consists of four object properties, 23 data properties, and 29 individuals.

The ontology enables representing three different aspects of information.
(1) Neural network-related general metadata and
(2) neural network-dependent features can be modeled, such as the type of layer, loss function, and optimizer.
(3) Layer-specific metadata is used to enhance the information basis of the specific layers, e.g., its keywords and parameters.
In the following, we will describe these three components of the \textsc{FAIRnets Ontology} correspondingly.\footnote{We will use \texttt{nno} as the prefix for the namespace \texttt{https://w3id.org/nno/ontology\#}}

\noindent\textbf{General information}
describe general components of the neural network, as well as the intended use.
For instance, the owner/developer of the (trained) neural network is modeled by using the property \texttt{dc:creator}. This attribute makes it possible to search for repositories by the author in the domain of neural networks.
Following the Linked Data Principles, the author is represented via a URI.
In this way, the authors are uniquely identified. Therefore, it is possible to link it to the Microsoft Academic Knowledge Graph \cite{Farber19} which models scholarly data such as scientific publications in which some of the represented neural network models are proposed and evaluated.
Moreover, a name (\texttt{rdfs:label}) and a description (\texttt{dc:description}) of the trained neural network are stored. The data property \texttt{nno:dataset} of type URI
allows us to specify the data set that was used to train the neural network.
This information already gives a more detailed insight into the neural network as well as the intended use of it.

Furthermore, the timestamp of creation date (\texttt{dc:created}) or last modification (\texttt{dc:modified}) allows assessing the currency of the neural network. \texttt{dc:license} indicates the rights to modify and redistribute that network.
Besides, the property \texttt{nno:hasRepositoryLink} allows linking to the repository in which the neural network is located.
Likewise, references to published papers can be included using \texttt{dc:references}.

\noindent\textbf{Model-specific information}
covers model-specific components of the neural network, such as optimization function denoted by \texttt{nno:hasOptimizer}.
The ontology covers modeling various loss functions, such as binary cross-entropy and mean squared error, via the property \texttt{nno:hasLossFunction}.
Loss functions are subdivided into classification and regression loss functions in the ontology to further indicate the intended use of the neural network.
The information about existing layers of the neural network can be linked via the property \texttt{nno:hasLayer}.
The loss functions and layer types available in Keras, an open-source deep learning framework to model neural networks, served as a basis to model available loss functions and layers.

\noindent\textbf{Layer-specific metadata} outline additional information about the individual layer. The layers of neural networks are subdivided into subclasses such as core, recurrent, and convolutional layer.
These classes are further subdivided into more specific layer classes. This specification derived from Keras enables to categorize the neural networks. For example, a neural network with a layer from class convolutional layer can be assigned to the type convolutional neural network.
Furthermore, the hyperparameters (e.g., kernel size, stride, and padding) are denoted by \texttt{nno:hasLayerKeywords} and saved as a dictionary. Additional values in the layer are denoted by \texttt{nno:hasLayerParameter}.

Most of the categories, properties, and instances are annotated with a label (\texttt{rdfs:label}), a description (\texttt{rdfs:comment}), and, if given, a link (\texttt{rdfs:seeAlso}) which make it easy for ontology users to identify the intended use of categories, properties, and instances, therefore supporting the reusability.

\subsection{Provisioning}
The World Wide Web Consortium (W3C) Permanent Identifier Community Group service is used to provide secure and permanent URL forwarding to the ontology. The \textsc{FAIRnets Ontology} in syntax turtle is accessible under \url{https://w3id.org/nno/ontology}.
Moreover, the ontology has been registered at LOV.\footnote{\url{https://lov.linkeddata.es/dataset/lov/vocabs/nno}, last acc. 2020-10-15}
The ontology is licensed under Creative Commons BY 4.0\footnote{\label{CC}\url{https://creativecommons.org/licenses/by/4.0/}, last acc. 2020-10-15} which allows its wide usage.
Furthermore, the ontology follows the 5-Star Linked Data Principles\footnote{\label{linkeddata}\url{https://5stardata.info/en/}, last acc. 2020-10-15} and can, therefore, be easily reused. A VoID file is provided under \url{https://w3id.org/nno/fairnetsvoid} including provisioning information.

\section{FAIRnets Knowledge Graph}
\label{sec:search_engine}

Apart from the ontology, we provide the \textsc{FAIRnets} knowledge graph, which is based on the \textsc{FAIRnets Ontology}.
The knowledge graph allows us to store knowledge (in our case, detailed metadata for neural network models) intuitively as a graph. Existing and widely used W3C standards and recommendations, such as RDF and SPARQL, can be used to query the knowledge graph and to integrate relatively easily into existing frameworks and systems.
For instance, \textsc{FAIRnets} is already integrated into KBox~\cite{kbox} which is a data management framework, allowing users to share resources among different applications.

\subsection{Creation Process}
\label{sec:DatasetCreation}

The previous online available neural network repositories such as Keras,\footnote{\label{keras}\url{https://keras.io}, last acc. 2020-10-15} Caffe Model Zoo,\footnote{\label{modelzoo}\url{https://github.com/BVLC/caffe/wiki/Model-Zoo}, last acc. 2020-10-15} and
Wolfram Alpha\footnote{\label{wolfram}\url{https://resources.wolframcloud.com/NeuralNetRepository}, last acc. 2020-10-15} are rather small (under one hundred neural networks) and not sufficient to present trends in the development and usage of neural networks.
General-purpose online code-sharing services, such as GitHub\footnote{\url{https://www.github.com}, last acc. 2020-10-15} and Bitbucket,\footnote{\url{https://www.bitbucket.org}, last acc. 2020-10-15} in contrast, contain many repositories of different nature. We, thus, decided to use GitHub since it is the largest host of repositories. Details about the nontrivial extraction process are given in the following.

\paragraph{Data Source.}
We extract and represent metadata of publicly available, trained neural network models in RDF* (i.e. RDF and RDFS) based on the \textsc{FAIRnets Ontology}.
Information from SemanGit~\cite{semangit} and GHTorrent~\cite{ghtorrent} can be used to identify GitHub repositories. SemanGit and GHTorrent provide a collection of data extracted from GitHub. In total there are more than 119 million repositories available in the GHTorrent data collection.
However, SemanGit and GHTorrent have a different focus and do not provide all the information which we wanted to provide in the \textsc{FAIRnets} knowledge graph. For instance, information about the architectures of neural networks within the repositories, the creation date of the repositories, as well as the watcher count is not included. We, therefore, directly accessed the GitHub Repository API and queried available neural network repositories.
We used the search term `neural network' and filtered for repositories that use Python as a programming language.
We accessed these repositories\footnote{Exemplary GitHub API Request: \url{https://api.github.com/repos/dmnelson/sentiment-analysis-imdb}, last acc. 2020-10-15.\label{note:example_request}} and extracted the neural network metadata.

\paragraph{Extraction Process.}
The difficulty lies in the extraction of the architecture information from the code. We narrowed our extraction down on neural networks implemented in Python. Still, it is difficult to identify the Python file which models a neural network. Therefore, we started with h5 files which are an open-source technology for storing trained machine learning models. Neural networks that have been trained with Keras, for example, can be stored in this format. The h5 file contains information about the neural network, e.g., the sequence of layers, used activation functions, optimization function, and loss function. Accessing the information in the h5 file makes it easier to identify and extract the architecture of the neural network.
However, not every repository contains trained neural networks in h5 files. The reason is that trained neural networks often take up a lot of storage space. Thus, our contribution is the information extraction from the code directly which will be described below.

{
\begin{table}[tbp]
\centering
\caption{Mapping of GitHub REST API values to the general components in \textsc{FAIRnets}.}
\begin{tabular}{p{3.8cm}p{5cm}}\toprule
\textbf{GitHub API} & \textbf{FAIRnets Ontology} \\ \midrule
created\_at & \texttt{dc:created} \\
description, readme & \texttt{dc:description} \\
html\_url & \texttt{nno:hasRepositoryLink} \\
license & \texttt{dc:license} \\
owner[`html\_url'] & \texttt{dc:creator} \\
updated\_at & \texttt{dc:modified} \\
watchers\_count & \texttt{nno:stars} \\
name & \texttt{rdfs:label} \\
topics[`names'] & \texttt{doap:category} \\
\bottomrule
\end{tabular}
\label{tab:mapping}
\end{table}
}

\noindent\textbf{General Information:}
The mapping of the values from the Github API with the corresponding general component properties in \textsc{FAIRnets} can be seen in Tab.~\ref{tab:mapping}.
We use the \textit{full\_name} of the GitHub REST API as a unique identifier (e.g., `dmnelson/sentiment-analysis-imdb' in note \ref{note:example_request}).
The \textit{full\_name} consists of the GitHub username combined with the name of the repository.
The owner of the repository is also the owner of the neural network.
Moreover, we store the link (\texttt{nno:hasRepositoryLink}), the time of creation (\texttt{dc:created}), and the last modification (\texttt{dc:modified}) of the repository. As a description of the neural network (\texttt{dc:description}), we extracted automatically the description and readme file of the GitHub repository. This gives a summary of the possible use of the neural network.
Furthermore, license information about the neural network is extracted and modeled in the knowledge graph, if available.
This information is crucial regarding the reusability of neural networks.
Given this information, it is possible to filter neural networks by license -- which is often an important constraint in industrial settings.
To enrich the knowledge graph \textsc{FAIRnets} with information according to the usage of a neural network, we extract the topics\footnote{\url{https://developer.github.com/v3/repos/\#list-all-topics-for-a-repository}, last acc. 2020-10-15.} of each repository from the GitHub repositories and store them as \texttt{doap:category}.

Additionally, we extract arXiv HTTP links within the readme file and map them to \texttt{dc:references}. If BibTex file codes can be found in the readme file, we extract the URL information from the BibTex entry and link it by using the property \texttt{dc:references}. The property \texttt{dc:references} is only intended for scientific contributions. By linking it with URLs from BibTex entries and arXiv links, we ensure this condition. Other links in the readme file are linked to the neural network using \texttt{rdfs:seeAlso}.

\noindent\textbf{Model \& Technical Information:}
The main feature of \textsc{FAIRnets} is the modeling of neural networks. We can model the structure and technical components of neural networks by employing the \textsc{FAIRnets Ontology}.
To extract the neural network information from the repositories we consider all Python files in the repositories. Each repository can contain several models of a neural network.
In general, it is difficult to extract the architecture information automatically without executing the source code. By executing the code, you can save the neural network model, for example in h5, and retrieve the information easier. We seek a more elegant way by saving execution costs and use language processing to extract the information.
Due to that, we focus on Python files with static variables.
Despite this restriction, there are still challenges because of various programming styles such as inconsistent naming of variables, complex loop constructions, different structures of code, and other logic statements. Another challenge is changing parameter naming due to different framework versions which are usually not stated.
To solve these tasks, a general method is generated using Python Abstract Syntax Trees (AST) module.\footnote{\url{https://docs.python.org/3/library/ast.html}, last acc. 2020-10-15} The AST module helps Python applications to process trees of the Python abstract syntax grammar. We focused on Keras applications of neural networks to extract the architecture because it is the most used deep learning framework among the top-winners on Kaggle.\textsuperscript{\ref{keras}}
The information on the architecture of the neural network is then modeled by using the schema and properties provided by the \textsc{FAIRnets Ontology}.
Also, the individual layers and their hyperparameters are stored in our knowledge graph. Likewise, the used optimization function and loss function are stored, among other things, allowing us to infer whether the neural network is used for classification or regression.
Our code can be found on GitHub.\footnote{\url{https://github.com/annugyen/FAIRnets}}

\paragraph{Evaluation.}
To evaluate the accuracy of our information extraction, we manually went through 50 examples where we judged the extraction of the GitHub Repository API in Tab.~\ref{tab:mapping}. The evaluation was in all cases correct. In the case of the neural network architecture, we used the h5 files, if available, in the repositories.
We were able to evaluate over 1,343 h5 files with architecture information (i.e., layer information) which overlap with the architecture extracted from the code with 54\% accuracy. Due to later modifications in the code it is possible that the overlap with the h5 file does not apply anymore (e.g., if a layer is commented out).

\subsection{Provisioning}
Just like the \textsc{FAIRnets Ontology}, the knowledge graph \textsc{FAIRnets} is also based on the 5-Star Linked Data Principles.
The knowledge graph is accessible under a persistent URI from w3id and additionally provided on Zenodo.
In combining FAIR principles and Linked Data Principles using URIs to identify things, providing information using RDF*, and linking to other URIs, it is possible to easily reference and use \textsc{FAIRnets} (see Sec.~\ref{sec:impact}). Machine-readable metadata allows us to describe and search for neural networks.
The knowledge graph \textsc{FAIRnets}, like the \textsc{Ontology}, is published under the Creative Commons BY 4.0 license.\textsuperscript{\ref{CC}}
A VoID file describing the knowledge graph in a machine-readable format is provided under \url{https://w3id.org/nno/fairnetsvoid}.

\subsection{Statistical Analysis of the FAIRnets Knowledge Graph}
Tab.~\ref{tab:numbers} shows some key figures about the created knowledge graph.
It consists of 18,463 neural networks, retrieved from 9,516 repositories, and provided by 8,637 unique users.
The creation time of the neural networks in our knowledge graph ranges from January 2015 to June 2019. All these networks have a link to the respective repository and owner.
Based on the used layers, we can infer the type of neural network. If a network uses a convolutional layer, it is inferred that the network is a convolutional neural network (CNN). Likewise, if a network contains a recurrent layer, it is inferred that the network is a recurrent neural network (RNN). For simplicity, if none of those two layer types are used, the default claim for the network is a feed-forward neural network (FFNN).
Of the total 18,463 neural networks, FFNN is most represented in the knowledge graph comprising half of the neural networks.
CNNs follows with 36\% and RNN with 16\% of the total number of neural networks.

{
\begin{table}[tbp]
\centering
\caption{Statistical key figures about \textsc{FAIRnets}.}
\begin{tabular}{p{4cm}p{3cm}}\toprule
\textbf{Key Figure} & \textbf{Value} \\ \midrule
repositories  & 9,516 \\
unique users & 8,637 \\
neural networks & 18,463 \\
\hspace{0.2cm} FFNN & 8,924 (48\%)\\
\hspace{0.2cm} CNN & 6,667 (36\%)\\
\hspace{0.2cm} RNN & 2,872 (16\%)\\
\bottomrule
\end{tabular}
\label{tab:numbers}
\end{table}
}