\section{Introduction}
Imagine that your town is preparing for a viral outbreak
which is projected to kill 600 people. Two alternative programs to combat the virus have been proposed. Assume that the exact scientific estimates of the consequences of the programs are {\bf Program A:} ``{\em 200 people will be saved}''; and {\bf Program B:} ``{\em 1/3 probability that all 600 lives will be saved; 2/3 probability that no lives will be saved}''. Given these choices, which program would you choose? Alternatively, if choices were presented as follows, which program would you choose?
{\bf Program C:} ``{\em 400 people will die}''; and {\bf Program D:} ``{\em 1/3 probability that no one will die and a 2/3 probability that all 600 will die}''.
This problem
is a modified version of the {\em Asian disease problem} (ADP) \cite{tversky1981framing}, a well-studied  {\em risky decision-making problem} (RDMP) in psychology where decisions are made under risk or include probabilistic outcomes \cite{edwards1954theory}. In this RDMP, programs A and B form the {\em gain frame} where choices are worded in a positive and optimistic manner, whereas programs C and D form the {\em loss frame} where choices are written in a negative and pessimistic manner. Studies have validated that in the gain frame, humans overwhelming{\color{black} ly} prefer the safe choice A (72\%), whereas in the loss frame, they overwhelmingly prefer the risky choice D (78\%)  even though the choices and outcomes in both frames are equivalent \cite{tversky1981framing}. This phenomenon, known as the {\em Allais paradox}, implies that observed human choices are inconsistent with predictions based on expected utility alone, thereby confirming the influence of language, wording of choices, and sentiments on human decision-making.

Being able to understand, model and predict human decision-making leads to many real-world applications, from predicting election results \cite{hillygus2005moral}, to improving user experience in recommender systems \cite{chen2013human}.
However, Allais paradox means that understanding the integral but complex cognitive process of decision-making, particularly in humans, is extremely challenging due to our diverse characteristics, beliefs and experiences. Furthermore, human decision-making is often fraught with irrationality
even in the presence of overwhelming evidence against some choice or beliefs \cite{simon1993decision}. This brings into question how human decision-making can be modelled with these complexities and nuances involved. This is an especially important task when considering current approaches to decision-making, such as utility theory which typically lacks any behavioural
basis and
ignore human sentiments
during human decision-making \cite{lerner2015emotion}.

Our goal is to develop a model of automated human decision-making that bridges current decision-making techniques with {\em fuzzy trace theory} (FTT), an established cognitive theory to predict group and individual decision making outlined in sections \ref{sec:task}.
Originally proposed by Brainerd and Reyna in the 1990s, FTT
aims to explain cognitive phenomena in memory and reasoning \cite{brainerd1990gist}. In a nutshell, FTT posits that humans form two types of mental representations, known as \textit{verbatim} which are detailed representations and \textit{gist} which are fuzzy representations that only capture the most quintessential meanings, and people prefer to make decisions based on gist rather than verbatim representations.

In contrast with alternative cognitive and decision-making theories
such as expected utility theory \cite{friedman1952expected} and prospect theory \cite{kahneman1980prospect}, we adopt FTT for two reasons. Firstly, FTT is the most holistic cognitive model which encompasses theories of how information is stored in memory and how memory plays an important role in our
decision-making rather than treating decision-making as an isolated process. Because of this, FTT provides us with an extensive set of tools to explain and evaluate decision-making. Secondly, is FTTs suitability for computational modelling as conceptual parallels can be drawn between representation learning, particularly in neural-based {\color{black} language modelling,} and the process of creating gist representations by distilling the {\color{black} quintessential} information. For example, popular embedding methods for words, sentences and documents in NLP aim to create fuzzy semantic representations through dimensionality reduction of language to semantic vectors which can be viewed as gist representations of the original language \cite{liu2020representation}.

\noindent \textbf{Contributions:}
We investigate two levels of text-based risky decision prediction tasks, group and individual-level prediction from a computational standpoint and incorporating state-of-the-art methods in NLP, we further investigate:
\begin{itemize}[leftmargin=*]
    \item {\em How do gist representations of choices give rise to decisions?} We present a
framework of decision-making based on gist representation learning.

\item {\em How can we computationally encode gist representations based on the language of choices?} {\color{black} We outline how gist representations can be computationally encoded using techniques in NLP and propose Category-to-Vector (Cat2Vec), to learn and predict categorical embeddings of choices.}

\item {\em How can we extract the underlying sentiments of gist representations?} By extending Cat2Vec, we show how sentiments can be learnt at a categorical level; this differs from traditional approaches of sentiment analysis in NLP that examine sentiments at a text level.

\item {\em How can individual differences of individuals and groups be modelled, what impact do these differences have on decision-making?}
We propose that individual differences are mechanisms that can encode errors at various points in the decision-making process and propose an optimisation method to infer these individual differences.

\item Finally, we demonstrate in experiments that our proposed model achieves state-of-the-art performance in predicting group and individual-based risky decision-making compared to baselines.
\end{itemize}

\section{Task Formulation and Related Work}

Risky decision-making has been studied in many different contexts. Here we formulate \emph{$n$-choice decision-making problem} ($n$DMP): Taking as input {\color{black} natural language descriptions of $n$} possible choices/outcomes $\mathcal{O}$,  choose the most preferred outcome from the set of choices $\mathcal{O}$. We focus on a sub-problem known as a \emph{$n$-choice risky decision-making problem} ($n$RDMP) which is an $n$DMP where there is some risk or probabilistic outcomes associated with choices in $\mathcal{O}$, e.g., programs B and D in the ADP. Specifically, we investigate the \emph{gain-loss framing problem} which is comprised of two nRDMPs, nRDMP$_{\text{gain}}$ where choices are written as {\em gain frames} which accentuate the positive features of the text, e.g., programs A and B form a 2RDMP$_{\text{gain}}$ where `saving people's lives' is the accentuated feature. Conversely, 2RDMP$_{\text{loss}}$ where choices are written as {\em loss frames} which accentuate the negative features of the text, e.g., programs C and D form a 2RDMP$_{\text{loss}}$ where `people dying' is the accentuated feature. Additionally, choices have equivalent outcomes across both 2RDMPs.

\subsection{Classical decision theory}
Classical decision theory abstracts the outcomes using utilities, which are numerical values that reflect desirability. For example, \textit{expected utility theory} (EUT)
identifies the choice that maximises the expected utility assuming the axioms of rationality \cite{von2007theory}.
However, in human decision-making these axioms are often violated, giving rise to, e.g., Allais \cite{allais1953comportement} and Ellsberg \cite{segal1987ellsberg} paradoxes.
Generalised EUT such as {\em uncertain utility theory} \cite{gul2008measurable}, {\em cumulative prospect theory} (CPT) \cite{tversky1992advances}, and {\em multiple-criteria decision-making} (MCDM) \cite{zeleny2012multiple} were proposed to resolve these discrepancies.
{\color{black} However, these classical approaches not only fail to take into account semantic information given by the working of choices which is important contextually for decision making, but they also ignore cognitive processes such as sentiments of decision-makers. }

Recent breakthroughs in NLP have led to a revolution in the breadth and robustness of problems that can be solved involving natural language by successfully capturing the underlying semantics and relationships of language. For example, neural language models
have found resounding success in representation learning \cite{mikolov2013efficient,devlin2018bert}, the task of uncovering feature representations of language which are useful for downstream NLP tasks. One such downstream NLP task, sentiment analysis,
has benefited largely from the application of language models such as XLNet \cite{yang2019xlnet} and ULMFiT \cite{howard2018universal}. Rapid advancements thus give hope for the development of sophisticated computational decision-making models.

\subsection{Group/Individual-level Tasks}\label{sec:task}

In this paper, we consider two specific 2RDMP, \emph{group level risky decision making} (GL-RDM) which  the majority of psychological studies focus on and the novel task of \emph{individual level risky decision making} (IL-RDM), defined as follows.

\noindent{\bf GL-RDM:} Given a set of observed outcomes from human RDM experiments,
each of which is described by a 5-tuple (2RDMP$_{gain}$, 2RDMP$_{loss}$, $P_{gain}$, $P_{loss}$, category), where 2RDMP$_{gain}$ is the gain frame of a 2RDMP, $P_{gain}$ is the proportion of individuals in the gain frame who chose the \textit{risky} choice, and $category$ is a grouping of similar experiments based on design and participants described in Section~\ref{exp:datasets}. 2RDMP$_{loss}$ and $P_{loss}$ can be defined similarly by replacing $gain$ with $loss$.
 GL-RDM's objective is to predict the distribution of choice between $P_{gain}$ and $P_{loss}$ and for unseen human experiments within the same category.

\noindent{\bf IL-RDM:} Given a set of $n$RDMPs, RDP = $\{rdp_1, rdp_2, \ldots, rdp_n\}$ where gain/loss frames of the same problem can appear as separate RDPs $rdp_i$, a set of individuals $Ivd = {ivd_1, ivd_2, \ldots, ivd_m}$ and a function which maps individuals and RDPs to their preferred choice $PC(id_i,rdp_j) = pc_{i,j}$ where $pc_{i,j}$ is individual $id_i$’s preferred choice for $rdp_j$. The objective for IL-RDM is to learn a model/mapping function for each individual which can predict an individual’s preferred choice for unseen $n$RDMPs.

\section{FTT-guided Risky Decision-making}

\noindent {\bf The BR model.}
Broniatowski and Reyna laid out four main FTT principles in developing a cognitive model, i.e., the {\em BR model}, for the GL-RDM task \cite{broniatowski2018formal,broniatowski2014mathematical}. These principles are: ({\bf C1}) Decision choices are encoded in different levels of
gist representations, e.g., {\em categorical-}
and {\em interval-}levels based on the psychological notion of levels of measurement \cite{stevens1946theory}. ({\bf C2}) Categorical gist representations of choices are distinguished based on binary (positive/negative) sentiments and decision-makers will prefer options with positive associations. In the BR model, sentiments of categories are drawn upon social and moral principles which are stored in long-term memory, e.g., saving lives is fundamentally good. ({\bf C3}) When comparisons of categorical gist representations do not arrive at a conclusive result, the decision-maker will revert to more precise gist representations. In the BR model, gist representations compete and combine such that the simplest gist representation is chosen. ({\bf C4}) Categorical gist is encoded based on the decision-maker's prior experiences and individual differences, i.e.,
{\em need for cognition} (NFC), {\em numeracy} (NUM), and {\em risk sensitivity} (RS).

Human experiments have provided evidence that the BR model is capable of explaining GL-RDM. However, being a box-arrow model, the BR model is comprised of hypothesized concepts or processes that lack precise definitions. Hence applying the model requires human interpretations and judgements on, e.g.,  notions such as gist lattices of each RDMP, the acquisition of sentiments, and individual differences. This informal nature, along with the inflexibility of the model being unable to be easily adapted to IL-RDM prevents the model from being used as an automated predictive tool.

\smallskip

\noindent {\bf Our  model.} Towards a fully automated tool for the RDMP tasks, we propose a computational model of
risky decision-making that takes the input text descriptions of an RDMP and solves the GL-RDM and IL-RDM tasks automatically. The model is depicted in Figure~\ref{fig:model}. The key features of our model include:
(1) All model components are automated, i.e., gist representations are extracted through NLP as categorical embeddings.
(2) Categorical and interval representations are formally defined as hierarchical with the interval level encapsulating the properties and information of the categorical-level \cite{stevens1946theory}.
(3) Individualistic differences, NFC, NUM and RS (see below) directly affect decision-making at a representational level and errors in judgement can propagate through the model adding more expressive.

\begin{figure*}[h]
  \centering
  \includegraphics[scale=0.55]{figures/ComputationFTTModelV4.pdf}
  \caption{The main architecture of our computational model for decision making based on FTT}
 \label{fig:model}
\end{figure*}

\section{Computing Gist Representations}

The first challenge we tackle is the computational encoding of gist representations and how individual differences encode \textit{error}, a mechanism to model variations in human decision-making at a representation level to perform GL-RDM and IL-RDM.

\subsection{Categorical Representations}

{\em Categorisation} is the act of grouping documents into categories based on semantic or sentiment similarity. For example, the {\tt entertainment} category in the news dataset (see Section~\ref{exp:datasets}) comprises of various articles spanning multiple topics such as games, movie reviews, and celebrity gossip. The ability to categorise and recall the underlying sentiments of categories is an important prerequisite for FTT decision making asserted by principle C2 where humans prefer choices associated with categories with positive connotations over negative connotations. For example, the sentiments of the {\tt travel} category in the news dataset has a strong negative sentiment due to the news articles being collected during the outbreak of COVID-19. Given this negative sentiment, people would be dissuaded from travelling. Current sentiment analysis methods focus on granular extraction of sentiments from text rather than categories where words that are highly indicative of a category do not necessarily reveal any insights into their sentiment.

Vector representations of words \cite{mikolov2013efficient}, sentences \cite{devlin2018bert}, and documents \cite{le2014distributed} capture the semantic relationships between entities. At a higher level, a {\em categorical embedding} should capture semantic relations between categories of documents. To our knowledge, no such representation has been proposed. To fill this gap, we propose \textit{Category-2-Vector} (Cat2Vec) and a sentiment based extension, {\em sentiment-Cat2Vec}.
Cat2Vec aims to find model-agnostic categorical representations that facilitates the prediction of categories from text and sentiments from categories. More formally, given a set of $M$ categories $C = \{k_1,k_2,\ldots,k_M\}$, a training set contains a number $N$ of document-category pairs $\{(d_1,c_1),\ldots, (d_N, c_N)\}$, where each $d_i$ is a document and $c_i\in C$ is the (ground truth) category of $d_i$.
The objective is to maximise the average log probability $\frac{1}{N}\sum^{N}_{i=1}\log P\left(c_{i} \vert d_i\right)$

where $P(c_{i}\vert d_i)$ is the probability that document $d_i$ belongs to category $c_i$. {\color{black} In sentiment-cat2vec, $P(c_{i}\vert d_i)$ is replaced by $P(s_{i}\vert c_i)$, the probability that category $c_i$ belongs to a certain sentiment class. Here, we consider only binary positive and negative sentiments.

Cat2Vec extends a contrastive learning via negative sampling
approach by simultaneously maximising the similarity between document encodings, $v_{d_i}$, with true category embeddings, $v_{c_{i}}$, by minimising the similarity between $v_{d_i}$ and $K$ negative category embeddings defined by the objective:

\begin{multline}\label{eqn:neg_objective}
    \displaystyle \log \sigma \left((v_{c_{i}} \odot v_{i_{i}})\cdot v_{d_i}\right) \\ + \sum^{K}_{j=1} \mathbb{E}_{k_j \sim P_\text{noise}(C)}[\log \sigma ((-v_{k_j} \odot v_{i_{j}}) \cdot v_{d_i})]
\end{multline}

where $\odot$ represents element-wise multiplication, $P_\text{noise}(C)$ is a noise distribution that dictates how categories are sampled, we select a uniform distribution, $\sigma(x) = 1/(1 + \exp(-x))$ and $v_{i_{i}}$ is a category importance vector for category $i$ which is learned simultaneously with the category embedding which provides an attention-like effect over category by accentuating or diminishing certain features in the category embedding when multiplied together. Furthermore, $v_{d_i} =  Enc(d_i)$ where Enc is a document vector encoding function. In this paper we adopt a bi-directional LSTM with self-attention such that $v_{d_i} = (\overrightarrow{\alpha} \odot \overrightarrow{v}_{d_i} \| \overleftarrow{\alpha} \odot \overleftarrow{v}_{d_i})$ where $\overrightarrow{\alpha}, \overleftarrow{\alpha}$ are  self-attention weights of the forwards and backwards LSTMs, resp., and $\overrightarrow{v}_{d_i}$, $\overleftarrow{v}_{d_i}$ are the hidden state output vectors for document $d_i$ of the forward and backwards LSTMs, respectively. However, the encoder is interchangeable in Cat2Vec e.g. pretrained transformers like BERT \cite{devlin2018bert} can be used.

The novelty of our model lies in two main aspects, the introduction of a category importance vector to improve the ability of the model to learn relations between categories and the ability of our model to estimate $P(s_{i}\vert c_i)$ given labelled text documents. To estimate $P(s_{i}\vert c_i)$ we introduce an extra dense output layer (D) in figure \ref{fig:cat2vec} which predicts $P(s|d_i)$, the probability that document $i$ belongs to a certain sentiment class. In the case of binary sentiments, the joint loss becomes the binary cross-entropy loss of predicting the correct sentiment of a document plus the negative sampling loss in equation \ref{eqn:neg_objective}. After training the model we can estimate $P(s_{i}\vert c_i)$ by feeding the learned category embeddings, $(v_{c_{i}} \odot v_{i_{i}})$ into the output layers (D). Although these output layers are trained to learn $P(s|d_i)$, since the learned category embeddings are based on the document embeddings and are learned in the same semantic space, this approach gives us good estimates of $P(s_{i}\vert c_i)$.

}

\begin{figure}[h]
\includegraphics[scale=0.31]{figures/cat2vecv8.pdf}
  \caption{Cat2Vec Model}
 \label{fig:cat2vec}
\end{figure}

Equation~\ref{eqn:CU} shows how error encoded categorical utility (CU) is calculated from categorical representations where Category(choice) is a function that takes RDM choices as inputs and outputs the underlying category related to the choice, Sentiment(category) is a function which takes a category as input and outputs the underlying sentiments related to that category as $\mathrm{pos}_{\mathrm{category}} - \mathrm{neg}_\mathrm{{category}}$. Categorical error is encoded based on NFC, an individual's tendency to engage in and enjoy cognitive activities \cite{cacioppo1996dispositional}, can introduce error at a categorical level to account for individualism. To calculate an error encoded CU, we sample from a logistic distribution which is consistent with existing literature in qualitative discrete choice models \cite{mcfadden2001economic}. Formally,  $\text{NFC} \in (0,1)$ and $CU \thicksim \mathrm{Logistic}(\mu,s)$ where $\mu = \mathbb{E}[X]$ is the expected or true utility value and $s(\text{NFC}) = |\text{NFC} - 1| \times \mathbb{E}[X]$.

\begin{equation} \small \label{eqn:CU}
    \mathrm{CU} = \mathrm{Logistic}(\mathrm{Sentiment}(\mathrm{Category}(\mathrm{choice})), \mathrm{NFC}) \\
\end{equation}

\subsection{Interval Representations}
{\em Interval representations} are a more precise representation than categorical representation. It encodes the calculation of the expected value (EV) and utility of choices. Numerical information from text can be extracted using simple text extraction or {\em named entity recognition} (NER) \cite{nadeau2007survey} where probabilities and their associated quantities can be extracted as arrays, e.g., in program B of the RDMP in the introduction the probabilities would be $[1/3, 2/3]$ and their corresponding quantities would be $[600, 0]$.

Equation~\ref{eqn:IU} outlines the process to generate error-encoded interval utilities where CU is the categorical utility defined in equation \ref{eqn:CU} and EV is an expected value function which takes an input RDM choices and outputs the corresponding expected value associated with probabilities and quantities in choices which can extracted using standard text identification techniques such named entity recognition. Error is encoded based on NUM \cite{kahneman2003maps}, which measures a person's ability to interpret and work with numbers
to account for individualism is calculated as $IU \thicksim \mathrm{Logistic}(\mu,s)$ where  $\text{NUM} \in (0,1)$, $\mu = \mathbb{E}[X]$ is the true expected value and $s(\text{NUM}) = Q|\text{NUM} - 1| \times \mathbb{E}[X]$ where $Q$ is number of quantities in the choice to account for error involving multiple calculations.

\begin{equation} \label{eqn:IU}
    \mathrm{IU} = \mathrm{Logisitic}(\mathrm{EV}(\mathrm{choice}), \mathrm{NUM}) \cdot \mathrm{CU}
\end{equation}

\subsection{Representations for Decision Making}\label{}

Finally, combining these representations allows us to derive the most beneficial choice in an $n$RDMP. The {\em preferred categorical}, $\text{Pref}_{\text{Cat}}$ and {\em preferred interval}, $\text{Pref}_{\text{Int}}$ choices are calculated based on which choice maximises categorical and interval utilities, respectively.
If $\text{Pref}_{\text{Cat}}=\text{Pref}_{\text{Int}}$, there is a consensus on the best choice. If $\text{Pref}_{\text{Cat}}\neq \text{Pref}_{\text{Int}}$, there is no clear best choice. In this case, $RS$, a person's preference towards pursuing riskier but more rewarding decisions \cite{kacelnik1997risk}, is adopted as in the BR model. Risk sensitivity influences the probability of choosing the \textit{safest} or \textit{riskiest} choice in an $n$RDMP as $P(\mathrm{risky}) =1/(1 + e^{-RS})$ where $RS \in (-3, 3)$. The safest choice is one that involves the least probabilistic outcomes, whereas conversely, the riskiest choice involves the most probabilistic outcomes e.g., in the ADP in the introduction, program A is the safest as it involves one certain outcome while program B is the riskiest with two probabilistic outcomes.

\subsection{Decision Making: A Worked Example}

To demonstrate the fluidity of our model we apply our model to the ADP from the introduction.
In the gain frame, the predicted category of programs A and B using the pretrained Cat2Vec from the experiments predicts the {\tt life} category for both programs. The sentiments of the {\tt life} category predicted by Sentiment-Cat2Vec is 0.9999 positive and 0.0001 negative giving categorical utility defined as $\text{pos}_{\text{category}} - \text{neg}_{\text{category}}$ for both programs equal to 0.9998. Taking into account numerical information, the expected value of programs A and B is 200 people being saved, the interval utility is thus the expected value times the categorical utility which is 199.6 for both programs. No consensus between categorical or interval choices can be made due to unclear preferred choices for both. Thus, the final choice is decided by risk sensitivity.

Individual differences encode error and preferences into choices allowing for consensus to arise, e.g., a person with low numeracy will sample interval utilities from a logistic distribution with a larger spread than someone with high numeracy who samples utility close to the true utility. Because the error encoded utilities are sampled, the preferred choice can change on different runs of the problem; however, individual differences influence the average choice. Figure \ref{fig:params} shows a snapshot when one parameter was altered while the others were fixed and how these parameters can alter utilities to prefer certain choices across frames in the ADP.

\begin{figure}[!h]

 \includegraphics[scale=0.35]{figures/paramsV2.png}
  \caption{Effects of individual differences on the ADP.}
 \label{fig:params}

\end{figure}

\section{Learning Individual Differences}

The last challenge we explore is how optimal individual-level parameters, NFC, NUM and RS can be inferred in GL-RDM and IL-RDM by optimising the following objective functions.

\begin{small}
\begin{equation}
\label{eqn:macro}
\argmin_{ivd} \sum^{\mathrm{Exp}}_{P_{\mathrm{gain}},P_{\mathrm{loss}}} |P_{\mathrm{gain}} - \hat{P}_{\mathrm{gain}}(ivd)| + |P_{\mathrm{loss}} - \hat{P}_{\mathrm{loss}}(ivd)|
\end{equation}
\end{small}

\begin{small}
\begin{equation}
\label{eqn:collective}
\begin{split}
    \hat{P}_{\mathrm{gain}}(ivd) = \sum_{exp_i \in \mathrm{Exp}} \frac{\mathbb{E}[\mathrm{CDM}(\mathrm{RDMP}_{gain}, ivd) = \mathrm{risky}]}{|\mathrm{Exp}|}
\end{split}
\end{equation}
\end{small}

\noindent {\bf GL-RDM Objective.} Is given by equation \ref{eqn:macro} where $ivd = (\mathrm{NUM}, \mathrm{NFC}, \mathrm{RS})$ are individual-level parameters which represent the characteristics of the entire group and Exp $= \{\mathrm{e}_1, \mathrm{e}_2, \ldots ,\mathrm{e}_i\}$ is the set of results based on human psychological experiments where each $\mathrm{e}$ is a 5-tuple described in the task formulation in section \ref{sec:task}.

\noindent {\bf IL-RDM Objective.} Is given by equation \ref{eqn:micro} where $ivd_i = (\mathrm{NUM}, \mathrm{NFC}, \mathrm{RS})$ is the parameters which characterises individual $i$, RDP is a set of $n$RDMPs and $PC$ is the mapping function of individuals to their preferred choices defined in the task formulation in section \ref{sec:task}. Thus, the goal is to learn optimal individual parameters for each individual which maximises the expectation that CDM chooses their true preferred choice over all RDPs.

\begin{small}
\begin{equation}
\label{eqn:micro}
\argmax_{ivd_i} \sum_j^{|\mathrm{RDP}|} \mathbb{E}[\text{CDM}(\mathrm{rdp}_j, ivd_i) = PC(ivd_i,\mathrm{rdp}_j)]
\end{equation}
\end{small}

\vspace*{-0.1cm}\section{Experiments}

\subsection{Datasets}\label{exp:datasets}

\noindent \textbf{Categorical News.} A dataset used for training/fine-tuning Cat2Vec and benchmark algorithms. The dataset contains 22601 news articles with binary sentiments labelled from various news outlets dating from February to April 2020 using the Google News API spanning 46 news categories, e.g. {\tt travel}, {\tt entertainment} and {\tt death}.

\noindent\textbf{Group Risky Decision Making.} A dataset of 88 psychological human experiments results grouped into categories used in the evaluation of the BR model. The categories represent differences in experiment controls and participants that undertook each experiment, e.g., 'ADP; within-subjects, low PISA'.
The category outlines the risky decision-making problem; experimental design which can be grouped into \emph{within}, where each participant is given both frames of a decision or \emph{between} subject designs, where two independent groups answer each frame; and numeracy of participants, based on the performance of the country in which the experiment took place in the Program for International Student Assessment (PISA) \cite{stacey2015international}.

\noindent \textbf{Individual 2-RDMP Prediction.} A curated dataset of 38 unique 2-RDMPs selected from various psychological experiments regarding risky decision-making answered by 121 university students using a within-subject experimental design. Of the 38 2-RDMPs, most problems contain a corresponding gain and loss frame, e.g., the ADP in the introduction, each frame is considered a separate problem. Participants selected their preferred choice from the same pre-shuffled RDMP set\footnote{See appendix, section \ref{appendix:questionnaire} for questionnaire} and no pre/post-processing of data was performed.

\subsection{Evaluation Metrics}

We apply different evaluation metrics suitable for each RDM task. For GL-RDM, we compare the true log-odds ratio (LOR) given by equation \ref{eqn:LOR}, between experimental results predicted by our model and the BR baseline model. Intuitively, the LOR measures the consistency of choices across the gain and loss frames.

\begin{equation}\label{eqn:LOR}
    \mathrm{LOR}(P_{\mathrm{gain}}, P_{\mathrm{loss}}) = \ln\left(\frac{P_{\mathrm{gain}}(1-P_{\mathrm{loss}})}{P_{\mathrm{loss}}(1-P_{\mathrm{gain}})}\right)
\end{equation}

To determine the goodness-of-fit between the predicted LOR, we apply a hypothesis test, the Wald statistic ($\chi^2$) given by equation \ref{eqn:wald}. The standard error (SE) is given by equation \eqref{eqn:se} where $n_{\mathrm{safe,gain}}$ represents the number of individuals choosing the safe choice in the gain frame, $n_{\mathrm{safe,loss}}$, $n_{\mathrm{risky,gain}}$, $n_{\mathrm{risky,loss}}$  can be derived similarly. The standard error asymptotically approaches a normal distribution when $n$ is sufficiently large; thus, the associated Wald statistic, equation \eqref{eqn:wald}, follows a chi-square distribution with one degree of freedom.

\begin{small}
\begin{equation}\label{eqn:se}
    {\displaystyle \mathrm{SE} = \sqrt{\frac{1}{n_{\mathrm{safe,gain}}} + \frac{1}{n_{\mathrm{safe,loss}}} + \frac{1}{n_{\mathrm{risky,gain}}} + \frac{1}{n_{\mathrm{risky,loss}}}}}
\end{equation}
\end{small}

\begin{small}
\begin{equation}\label{eqn:wald}
   {\displaystyle \chi^2 = \left(\frac{\mathrm{LOR}(P_{\mathrm{gain}}, P_{\mathrm{loss}}) - \mathrm{LOR}(\hat{P}_{\mathrm{gain}}, \hat{P}_{\mathrm{loss}})}{\mathrm{SE}}\right)^2 }
\end{equation}
\end{small}

To compare the parsimony and implicitly the error between our the BR and null \cite{Busemeyer2015} models, we use the  Akaike information criterion (AIC) and Bayesian information criterion (BIC). For IL-RDM, we evaluate the accuracy of each model correctly predicting the true choices for each individual.

\subsection{Benchmark Algorithms}

In the paper, we use two different sets of baselines. For GL-RDM, we directly compare our model against the BR model. Due to the small number of experiments per grouping in the GL-RDM dataset, to maintain parity with the BR baseline, we apply the same jackknife-leave-one-out (JLOO) method  used for parameter estimation in the BR baseline model to avoid post-hoc parameter estimation \cite{busemeyer2000model}. Formally, given $m$ observed human risky decision making experiment results within a category of comparable RDPs, $\mathrm{Exp} = \{\mathrm{e}_1,\mathrm{e}_2,\ldots,\mathrm{e}_m\}$ as described in the task formulation in section \ref{sec:task}. We wish to estimate $m$ values of $G_i = (\text{NUM}_i, \text{NFC}_i, \text{RS}_i)$ where $G_i$ is group-level differences relating to observed experiments $i$ where $i = 1 \ldots m$. To achieve this, we apply the  $G_i$ can be estimated by equation \eqref{eqn:JLOO} where $\mathrm{ER}_{-i}$ is the set of experimental results excluding $\mathrm{er}_i$ as not to use the result in the estimation.

\begin{equation}\label{eqn:JLOO}
        {\displaystyle \argmin_{G_{i}} \sum^{\mathrm{ER}_{-i}}_{P_{\mathrm{gain}},P_{\mathrm{loss}}}}
        {\scriptstyle |P_{\mathrm{gain}} - \hat{P}_{\mathrm{gain}}(G_i)| + |P_{\mathrm{loss}} - \hat{P}_{\mathrm{loss}}(G_i)| }
\end{equation}

For IL-RDM, due to a lack of existing benchmark algorithms we compare our model against two baselines (1) Naive binary model using pretrained transformer language models where all RDM-choices are combined as a single input and outputs 0 or 1 corresponding to the safe or risky choice. (2) Sentiment analysis models as claim C2 asserts sentiments are highly influential in decision-making where decisions are based on choices with the highest positive sentiment. \textbf{Random:} Uniformly samples one of the available choices.\  \textbf{Vader:} A rule-based sentiment analysis for social media\cite{gilbert2014vader}. \  \textbf{XLNet:} SOTA pretrained autoregressive language model fine-tuned on the news dataset sentiments \cite{yang2019xlnet}. \  \textbf{ULMFiT:} Pretrained language model fine-tuned on the news dataset sentiments using inductive transfer learning \cite{howard2018universal}.

\subsection{Experiment Results}

\noindent {\bf GL-RDM results.} Table~1 (full table \ref{appendix:table} in Appendix) shows key discrepancies between our computational model, CDM, compared to both the actual LOR based on all 88 human experiments and those predicted by the BR model. Within each category, we find optimal group-level parameters which minimise \eqref{eqn:macro} to calculate the predicted LOR of our model for each experiment using the jackknife-leave-one-out (JLOO) method to maintain comparability between the BR model.

\begin{table}[h]

\resizebox{0.5\textwidth}{!}{
\begin{tabular}{l | c | c | c c c} \label{table:macroresults}
Reference &  Actual & BR & CDM & SE &  $\chi^2$\\
\hline
\multicolumn{6}{c}{Standard ADP; one presentation, between-subjects, low PISA} \\
(1) \citet{tversky1981framing} & \bf{2.20} & \bf{1.65*} & \textbf{1.86} & \textbf{.26} & \textbf{1.83} \\

(2) \citet{mayhorn2002decisions}, Young & 2.98 & 1.68 & 1.50 & .58 & 5.89* \\

 \multicolumn{6}{r}{TOTAL of 14 predicted: 13 (93\%)} \\

\hline
\multicolumn{6}{c}{Standard ADP; within-subjects, low PISA} \\
(3) \citet{LeBoeuf2003} Exp \#2 & \bf{.57} & \bf{1.05*} & \bf{.81} & \bf{.17} & \bf{.52} \\
\multicolumn{6}{r}{TOTAL of 3 predicted: 3 (100\%)} \\
\hline
\multicolumn{6}{c}{Standard ADP; multiple presentations, between-subjects, low PISA,} \\
(4) \citet{Jou1996} & \bf{2.01} &  \bf{.87*} & \bf{1.13} & \bf{.33} & \bf{6.99*} \\
\multicolumn{6}{r}{TOTAL of 6 predicted: 5 (83\%)} \\
    \hline
 \multicolumn{6}{c}{Other problems; multiple presentations, between-subjects, high PISA} \\
(5)  \citet{kuhberger1995framing} Plant \#2 & \textbf{2.34} & \textbf{.7*} & \textbf{.34} & \textbf{.73} & \textbf{7.50*}\\
 \multicolumn{6}{r}{TOTAL of 4 predicted: 3 (75\%)} \\
     \hline
 \multicolumn{6}{c}{Zero-complement problems; multiple presentations, between-subjects} \\
(6)  \citet{kuhberger2010risky} Crops & -.43 & 0 & .34 & .30 & 6.83* \\
(7)  \citet{kuhberger2010risky} Fish disease & \bf{.83} & \bf{0*} & \bf{.37} & \bf{.30} & \bf{15.74*} \\
  \multicolumn{6}{r}{TOTAL of 7 predicted: 5 (71.4\%)} \\
     \hline
 \multicolumn{6}{c}{\small“400 not saved” certain-option problems; multiple presentations, between-subjects, high
PISA} \\
(8) \citet{kuhberger1995framing} Plant \#1 &  \textbf{.49} & \textbf{-.88*}  & \textbf{.11} & \textbf{.58} & \textbf{.50} \\
(9) \citet{kuhberger1995framing} Cancer \#1 &  -1.36 & -.74 & .11 & .60 & 6.21* \\
\multicolumn{6}{r}{TOTAL of 5 predicted: 6 (83.3\%)} \\
  \hline
\multicolumn{6}{r}{OVERALL TOTAL of 88 predicted: 82 (93.2\%)} \\
\hline
\multicolumn{6}{l}{* Indicates results with Wald statistics over 1 degree of freedom}\\
\multicolumn{6}{l}{Note: Bolded rows indicate results where CDM outperforms or is equal to the BR model}
\end{tabular}
}
\caption{Group Level Experiment Results.}
\end{table}

Critically, our results show that our computational model is capable of automating the prediction of human risky decision making on a wide range of RDMPs by predicting 82 of 88 (93.2\%) experiments based on the Wald statistic. These results hold even when RDMPs were manipulated to capture a wider gamut of decision making through variations on framing and truncation of choices where options were removed \cite{reyna2014developmental}. These results are comparable to carefully crafted human conducted analysis using the BR model which also predicted 82 of 88 experiments.

To further demonstrate the parsimony of our model compared to the BR and null models by applying the AIC and BIC metrics under a null CDM model where parameters are set to 0, we get AIC=14941 and BIC=14950. Whereas under the null model of the BR model, AIC=14981 and BIC=14986. In the best cases, our model outperforms all variations of the BR baseline model, with our model attaining AIC=13374 and BIC=13383 compared to AIC=13409 and BIC=13510. {\color{black} Furthermore, taking into consideration the relative likelihood ratio (RLR) to compare models using the AIC scores, $\exp((13374 - 13409)/2)=2.5 \times 10^{-8}$, yields a significant result where the BR baseline model is only $2.5 \times 10^{-8}$ times as probable as our model to minimize the information loss.} Thus, our model attains better goodness-of-fit compared to the BR model while using significantly fewer parameters, 3 compared to up to 172 in the BR model.

\noindent {\bf IL-RDM results.} Table~\ref{tab:micro} displays the average 5-fold cross-validation result predicting all 121 individuals' decisions for all 38 questions. Our model with a modest 63.19\% accuracy outperforms all benchmark algorithms which hover around 50\% for sentiment and 60\% for pretrained language model baselines. This reinforces that IL-RDM is a more challenging problem and although sentiment analysis is important for decision-making, current SOTA sentiment analysis is not suitable for IL-RDM and only performs comparably to random choice. It is worth noting that while pretrained language models can be naively applied to IL-RDM with competitive results, they can not be naively applied to GL-RDM which requires the simultaneous predictions of two distributions of choices across frames where often the same RDM and choices is used across all experiments within a category.

Also displayed in the table are results when using transformers as encoders within Cat2Vec and results from a minor ablation study. For IL-RDM, transformers do not significantly improve accuracy as the resulting predicted categories and sentiments of categories from RDM-choices are highly similar between encoders. In the ablation study where choices are derived based on preferred choices at different levels of representation, i.e., $\text{CDM}_{\text{Categorical}}$ and $\text{CDM}_{\text{Interval}}$, reinforces the full expressiveness of our model comes from the consensus between levels of representation and influence of individual differences.

\begin{table}[htp]
\centering
\small\setlength\tabcolsep{3pt}
\begin{tabular}{|c|c|c|c|}
\hline
Algorithm & Accuracy $(\%)$ & Min $(\%)$ & Max $(\%)$\\
\hline
Random & $ 49.87 \pm 0.4 $ & 48.99  & 51.23 \\
Vader & $51.37 \pm 0.9 $ & 48.64 & 54.33  \\
XLNet &  $49.83 \pm 2.1$  & 44.21 & 56.31\\
ULMFiT  & $47.08 \pm 2.1$ & 39.31 & 53.30\\
\hline
BERT& $61.94 \pm 0.7$ & \textbf{60.80} & 64.70  \\
GTP2 & $53.65 \pm 1.1$ & 51.44 & 57.95  \\
roBERTa & $60.83 \pm 1.7$ & 57.23 & 65.87 \\
\hline
CDM (Bi-LSTM) & $62.47 \pm 0.6$ & 60.43 & 64.11 \\
CDM (BERT) & $62.30 \pm 1.2$ & 59.54 & 65.87 \\
CDM (GTP2) & $\textbf{63.19}$ $\bf{\pm}$ $\textbf{1.2}$ & 60.64 & \textbf{68.00}  \\
CDM (roBERTa) & $62.68 \pm 1.2$ & 59.43 & 66.35  \\
\hline
Sentiment Cat2Vec & $ 53.72 \pm 1.4 $ & 48.04  & 56.67 \\
$\text{CDM}_{\text{Categorical}}$ & $ 51.86 \pm 1.3 $ & 46.38 & 54.33 \\
$\text{CDM}_{\text{Interval}}$ & $ 53.17 \pm 1.2 $  & 48.40 & 55.84  \\
\hline
\end{tabular}
\caption{Individual-Level Experiment Results}
\label{tab:micro}
\end{table}

\subsection{Error Analysis and Discussion}

To understand the shortfall of our model for both GL-RDM and IL-RDM, we analyse cases in which our model fails to predict human decision-making. In GL-RDM, of the 6 experiments that our model did not successfully predict, 3 of these ((4),(5) and (7) in table 1) were not predicted by the BR baseline model indicating problems with parameter estimation using JLOO as these experiments are outliers with relatively significant differences in LORs within their respective categories.

In IL-RDM, inconsistencies exist across 2-RDMPs due in part to the within-subject design as participants may notice the underlying problem causing them to compare between problems rather than independently \cite{kahneman2002representativeness}. For example, figure \ref{fig:IL-questions} shows loss frames where individuals overwhelming preferred the safe choice, e.g., Q2, Q4 and most gain-loss pairs do not show a clear distinction between safe and risky choices in opposing frames, e.g. (Q26, Q2). Both cases are inconsistent with psychological studies.

\begin{figure}[!h]
\includegraphics[scale=0.29]{figures/individual_answers2.png}
  \caption{Ratio of choices for all questions with gain and loss frames grouped.}
 \label{fig:IL-questions}
\end{figure}

Quantity of data is also an issue. While the number of participants and questions answered were quite large for psychology experiments, this dataset is relatively small for machine learning tasks. Figure \ref{fig:IL-distribution}(A) shows the histogram of all 121 individuals' test accuracy on one fold. Overall, our model can predict most individual's choices accurately, but the average is lowered by some individuals our model cannot predict due to inconsistencies mentioned in (1). Also, since the size of each fold is relatively small, containing 7-8 test RDPs, any RDP not predicted correctly will cause a large decrease in accuracy. Figure \ref{fig:IL-distribution}(B) shows the percentage of correct choices our model predicts for all individuals from the combined 5-fold test questions. On average, our model predicts gain and loss RDMPs relatively equally with accuracy of $65.73\%$ and $62.84\%$ respectively. However, RDMPs with \emph{"both frame"}, contains choices with combined gain and loss wording, cannot be predicted by our model due to this duality with an average of $42.73\%$.

\begin{figure}[!h]

\includegraphics[scale=0.26]{figures/individual_results.png}
  \caption{(A) Histogram of individual accuracy on one fold and (B) combined k-fold test accuracy per  question}
 \label{fig:IL-distribution}

\end{figure}

\section{Conclusion and Future Work}
This paper provides the first steps into a fully computational framework of risky decision-making, which adopts the cognitive and psychological basis of FTT with our model outperforming baselines in individual and group RDP prediction. Potential applications of our model are wide-ranging for scenarios in which predicting and understanding the characteristics of human risky decision-making is pivotal, e.g., the design of safety mechanisms based on how people make decisions in risky scenarios or in improving personalised recommendation systems based on understanding the users' personal traits and how they make decisions. Future work, therefore, involves adapting our model towards real-world applications, exploration of generalised decision-making and the design and evaluation of sophisticated end-to-end machine learning models for text-based decision-making.


\section{Introduction}

Entropy is an important concept in physics,
which is also the foundation of classical communication theory established by C. Shannon~\cite{Sha48}.
Information sources are modeled as random variables,
and the Shannon entropy of a source sets the bound below which
message can be reliably transmitted with a source encoding and decoding.
Furthermore, for noisy transmission over a channel,
the maximum mutual information between the sender and receiver
defines the channel capacity below which
message can be reliably transmitted with a channel encoding and decoding.
Shannon's theorems guarantee the viability of error correction,
setting the foundation of information science.

The field of quantum information science has been developed for decades~\cite{NC00,Hay17,Wil17,Wat18}.
The measure of quantum information is the von Neumann entropy,
and the quantum analog of Shannon's theorems and extensions have been established.
In order to harvest quantum advantages, however,
there are great challenges.
Besides the technical challenge to realize quantum error correction,
it is hard on the first hand to study the capacities of quantum channels.
Regularization is needed for both the classical and quantum capacities of a quantum channel,
i.e., a capacity may increase indefinitely when more runs of a channel are used,
while at the same time finding the optimal input achieving the capacity is not easy.
With entanglement assistance~\cite{BSS+99},
it turns out the capacities become additive,
hence reducing from the regularized one to the single-letter formula,
while finding the optimal assisted entangled state is also challenging.

Compared with classical ones,
quantum states and channels obey many appealing laws,
such as the uncertainty principle and the channel-state duality~\cite{Cho75,Jam72}.
The former one has inspired great promise for quantum cryptography~\cite{BB84},
while the later one will play a central role in our study.
Due to quantum entanglement,
quantum processes are required not only being positive,
but also completely positive,
which brings novel structures to quantum objects such as dilation and purification.
Meanwhile, as extension of classical ones,
quantum coding has proven to be promising~\cite{LB13},
which usually does not involve heavy asymptotic analysis of channel capacities.
All these hint that quantum information is of distinct nature from classical ones,
and there could be a proper way to drop the regularization requirement on capacities of quantum channels.
In this work, we find that this can indeed be achieved
by a slight refinement of the settings of quantum communication,
see Fig.~\ref{fig:capacity}.
What we modify is the notion of ensemble and the task for entanglement sharing
involved to define capacities.

\begin{figure}[b!]
    \centering
    \includegraphics[width=0.4\textwidth]{capacity}
    \caption{The capacities of quantum channels that are studied in this work which are all additive.}
    \label{fig:capacity}
\end{figure}

We find that, reducing the protocol of entanglement generation~\cite{Dev05} to entanglement distribution,
the quantum capacity is given by the coherent information~\cite{SN96}
of a channel when the input is the identity, hence additive.
Using the orthogonal ensemble,
the classical capacity becomes additive
without sacrificing the quantum features,
although allowing more general ensemble and entangled input states
can lead to peculiar phenomenon such as the super-activation~\cite{SY08}
but losing the additivity.
Our finding provides an information-theoretic interpretation of the channel-state duality,
and it confirms our intuition that,
due to the complete positivity requirement,
it is sometimes easier to compute the quantum capacities than classical ones.
Therefore, it can simplify the proofs of quantum Shannon theorems,
e.g., the strong converse channel coding theorems~\cite{Win99,ON99,BDH+14,TWW17}.
We also learn that quantum resources,
such as entanglement and coherence, need to be harvested in meticulous ways.
It also demonstrates the central roles of von Neumann entropy as the measure of quantum information.

\section{Quantum channels}

We study finite-dimensional Hilbert spaces.
Quantum states, or density operators $\rho \in \C D(\C X)$
are trace-class nonnegative semidefinite operators acting on a given Hilbert space $\C X$.
Quantum operations, also known as quantum channels,
are described as completely positive, trace-preserving (CPTP) maps of the form
\begin{equation} \Phi(\rho)= \sum_i K_i \rho K_i^\dagger, \end{equation}
for $\Phi$ forming a convex body $C(\C X, \C Y)$,
$\forall \rho \in \C D(\C X)$,
and $K_i$ known as Kraus operators satisfying $\sum_i K_i^\dagger K_i= \mathds{1}_d$,
for $\mathds{1}_d$ denoting the identity operator of dimension $d=\text{dim}\C X$.

A quantum channel $\Phi$ can be dilated to an isometry $V$ with
$\Phi(\rho)=\text{tr}_\text{E} V\rho V^\dagger$ for E denoting an `environment' (or Eve).
The isometry $V$ is formed by Kraus operators $V=\sum_i |i\rangle \otimes K_i$
for $|i\rangle$ as orthogonal states of E.
A complementary channel $\Phi^c$ can be defined as the map from the input to E,
and the state of E is
\begin{equation} \rho_\text{E}=\sum_{ij} \text{tr}(\rho K_i^\dagger K_j) |j\rangle \langle i|. \end{equation}

Any quantum channel $\Phi\in C(\C X, \C Y)$ can also be represented as its dual state
\begin{equation} \omega_{\Phi} := \Phi \otimes \mathds{1}_d (\omega), \end{equation}
usually known as a Choi state~\cite{Cho75}, for $\omega:=|\omega\rangle \langle \omega|$,
and $|\omega\rangle:= \sum_i |ii\rangle /\sqrt{d}$.
This is also called the channel-state duality.
The rank of the channel $\text{r}(\Phi)$ is the rank of $\omega_{\Phi}$.
The state $|\omega\rangle$ is a Bell state, also known as an ebit.

Choi states are bipartite and for clarity, we label the sites as A and B.
Let $\pi_d:=\mathds{1}_d /d$.
The partial trace of a Choi state is constrained as $\text{tr}_\text{B} \omega_\Phi= \pi_d$,
and $\text{tr}_\text{A} \omega_\Phi= \Phi(\pi_d)$.
Given $\omega_\Phi$, the action of the channel can be obtained as
\begin{equation} \Phi(\rho)= d \; \text{tr}_\text{A} [\omega_\Phi (\mathds{1} \otimes \rho^t) ], \label{eq:readout}\end{equation}
for $\rho^t$ as the transpose of a state $\rho \in \C D(\C X)$.
As has been shown~\cite{Wang20,Wang22}, this is sufficient to simulate the channel $\Phi$.
With a binary positive operator-valued measure (POVM) $\{\sqrt{\rho^t}, \sqrt{\mathds{1}-\rho^t}\}$ acting on A,
any observation $\C O$ on $\Phi(\rho)$ can be measured on site B.
This is heralded but deterministic, i.e.,
it belongs to the class of local operations with classical communication (LOCC).
This provides an operational interpretation of the channel-state duality.
We will use this fact to refine the notion of capacities of quantum channels.

There are a few important classes of channels we will need.
A channel is unital if $\Phi(\pi_d)=\pi_{d_o}$.
A channel is extreme iff the set $\{K_i^\dagger K_j\}$ is linearly independent~\cite{Cho75}.
A rank-two qubit channel is either extreme or unital~\cite{RSW02}.
A channel is entanglement-breaking (EB) iff its Kraus operators are all of rank one~\cite{HSR03}.
Namely, they can be written as $K_i=|x_i\rangle \langle y_i|$ for un-normalized vectors $|x_i\rangle$ and $|y_i\rangle$.
Another equivalent condition is that the Choi state is separable.
It becomes quantum-to-classical (QC) if $\{|x_i\rangle\}$ is orthonormal,
and classical-to-quantum (CQ) if $\{|y_i\rangle\}$ is orthonormal.

Two central measures for distances are fidelity and trace distance.
They satisfy the Fuchs-van de Graaf inequality
\begin{equation} 1-\sqrt{F(\rho,\sigma)} \leq D_t(\rho,\sigma) \leq \sqrt{1-F(\rho,\sigma)}, \label{eq:FG}\end{equation}
$\forall \rho, \sigma \in \C D(\C X)$,
the trace distance $D_t(\rho,\sigma):=\frac{1}{2}\|\rho-\sigma\|_1$,
and the fidelity $F(\rho,\sigma):=\|\sqrt{\rho}\sqrt{\sigma}\|_1^2$,
with $\|\cdot\|_1$ denoting the trace norm.
When one state is pure, say $\sigma$, the lower bound becomes $1-F(\rho,\sigma)$.
For channels, we use the diamond-norm distance~\cite{KSV02,Wat18}
$D_\diamond(\Phi, \Psi) =\|\Phi \otimes \mathds{1}- \Psi \otimes \mathds{1} \|_{1\rightarrow 1}$,
which relates to
the trace distance between Choi states $D_t(\omega_\Phi, \omega_\Psi)$ by~\cite{Wat18}
\begin{equation} \frac{1}{2d}D_\diamond( \Phi, \Psi ) \leq D_t(\omega_\Phi, \omega_\Psi) \leq \frac{1}{2} D_\diamond( \Phi, \Psi ). \label{eq:choidis} \end{equation}
The fidelity between Choi states is known as
the average entanglement fidelity~\cite{Sch96}
\begin{equation} F_E(\Phi, \Psi):=  F(\Phi \otimes \mathds{1} (\omega),  \Psi \otimes \mathds{1} (\omega)), \end{equation}
and it holds
\begin{equation} 1-\sqrt{F_E(\Phi,\Psi)} \leq D_t(\omega_{\Phi},\omega_{\Psi}) \leq \sqrt{1-F_E(\Phi,\Psi)}.\end{equation}
If one channel is unitary, $\C U$, then
\begin{equation} 1-F_E(\Phi,\C U) \leq D_t(\omega_{\Phi},\omega_{\C U}) \leq \sqrt{1-F_E(\Phi,\C U)}. \end{equation}

\section{Entropy}

The von Neumann entropy is defined as
\begin{equation} H(\rho)=\log d-R(\rho \| \pi_d), \end{equation}
for the quantum relative entropy $R(\rho \| \sigma)=\text{tr} \rho \log \rho - \text{tr} \rho \log \sigma$, $\forall \rho, \sigma \in \C D(\C X)$~\cite{NC00}.
It is monotonic $H(\Phi(\rho))\geq H(\rho)$ under unital channels $\Phi$
but not for non-unital ones.
Recall that the von Neumann entropy is uniquely defined by a set of axioms~\cite{Hay17}:
1) (normalization) $H(\pi_d)=\log d$;
2) (continuity) $H(\rho)$ is continuous for $\rho \in \C D(\C X)$;
3) (nonnegativity) $H(\rho)$ is nonnegative;
4) (invariance) $H(\rho)=H(V\rho V^\dagger)$ for any isometry $V$;
5) (additivity) $H(\rho\otimes \sigma)=H(\rho)+H(\sigma)$;
6) (subadditivity) $H(\rho_{AB})\leq H(\rho_A)+H(\rho_B)$.

With the eigenvalue decomposition $\rho=\sum_i p_i |i\rangle \langle i|$,
a purification of it is defined as $|\varphi_\rho\rangle = \sum_i \sqrt{p_i} |i\rangle  |i\rangle $.
The purification of $\pi_d$ is an ebit.
The coherent information $I_c(\rho,\Phi)$ is defined as~\cite{SN96,Llo97}
\begin{equation} I_c(\rho,\Phi):=H(\Phi(\rho))-H(\Phi\otimes \mathds{1}_d (\varphi_\rho) ), \end{equation}
and we also let $J(\rho,\Phi):=H(\rho)+ I_c(\rho,\Phi)$ be called the coherent mutual information,
which is always nonnegative.
An important property is that $J(\Phi):=\max_\rho J(\rho,\Phi)$ is additive~\cite{AC97}.

The coherent information is the negation of a conditional von Neumann entropy,
and it can be negative yet with an operational interpretation called state merging~\cite{HOW05}.
It satisfies the data-processing inequality for all channels~\cite{SN96}.
Now define \begin{equation} I(\Phi):=I_c(\pi_d,\Phi), \end{equation}
which, plus $\log d$, is the coherent mutual information contained in the Choi state $\omega_\Phi$.
There exists an intriguing relation between the rank and coherent information of a channel.
Recently it is shown that~\cite{SD21}
the maximum coherent information $I_c(\Phi):=\max_\rho I_c(\rho,\Phi)$
is almost surely positive if $\text{r}(\Phi) \leq d$; otherwise,
it is almost surely negative.
It is known that EB channels, whose Choi states are separable,
have negative or zero coherent information, and
necessarily are of rank no smaller than $d$,
the input system dimension.

\section{Quantum capacity}

We consider bipartite quantum communication.
Alice aims to send qubits over a noisy quantum channel to Bob with high-enough fidelity by encoding and decoding.
Given the operational meaning of Choi states,
it only needs to distribute ebits over the two parties.
With multiple copies of ebits and LOCC, Alice can send any state $\rho$ over to Bob.
Note a similar entanglement distribution task has been discussed~\cite{DHW04},
although did not connect with quantum
capacity~\footnote{A more precise term would be ``ebit distribution'' as entanglement distribution could refer to general entangled states. We shall keep this mind while without introducing more terms.}.
We closely follow the logic of the book~\cite{Wat18}.

\begin{definition}
(Entanglement distribution capacity of a channel)
Let $\Phi\in C(\C X, \C Y)$ be a channel, and an integer $m=\lfloor \alpha n \rfloor$
for all but finitely many positive integers $n$ and an achievable rate $\alpha \geq 0$,
there exists channels $\C E\in C(\C Z^{\otimes m}, \C X^{\otimes n})$
and $\C D\in C(\C Y^{\otimes n}, \C Z^{\otimes m})$ such that the fidelity satisfies
\begin{equation} F_E(\mathds{1}^{\otimes m}, \C D \Phi^{\otimes n} \C E)\geq 1- \epsilon\end{equation}
for every choice of a positive real number $\epsilon$,
and the entanglement distribution capacity of $\Phi$, denoted $Q_{ED}(\Phi)$,
is defined as the supremum of all $\alpha$.
\end{definition}

We will prove that $Q_{ED}$ is equal to the quantum capacity $Q$ defined below.
\begin{definition}
(Quantum capacity of a channel)
Let $\Phi\in C(\C X, \C Y)$ be a channel, and an integer $m=\lfloor \alpha n \rfloor$
for all but finitely many positive integers $n$ and an achievable rate $\alpha \geq 0$,
there exists channels $\C E\in C(\C Z^{\otimes m}, \C X^{\otimes n})$
and $\C D\in C(\C Y^{\otimes n}, \C Z^{\otimes m})$ such that
\begin{equation} D_\diamond (\mathds{1}^{\otimes m}, \C D \Phi^{\otimes n} \C E) \leq \epsilon\end{equation}
for every choice of a positive real number $\epsilon$
and the quantum capacity of $\Phi$, denoted $Q(\Phi)$,
is defined as the supremum of all $\alpha$.
\end{definition}

\begin{theorem}
Let $\Phi\in C(\C X, \C Y)$ be a channel, then $Q(\Phi)=Q_{ED}(\Phi)$.
\end{theorem}
\begin{proof}
The Fuchs-van de Graaf inequality~(\ref{eq:FG}) directly yields $Q(\Phi)\leq Q_{ED}(\Phi)$.
Theorem 8.45 of~\cite{Wat18} yields $Q(\Phi)\geq Q_{ED}(\Phi)$.
\end{proof}

From the channel-state duality, it is simple to expect $Q=Q_{ED}$.
However, the inequality between Choi states and diamond distance on channels~(\ref{eq:choidis})
is not enough to prove this due to a dimension-dependence issue.
Theorem 8.45 of~\cite{Wat18} (based on~\cite{BKN00}) is stronger,
which guarantees a small diamond distance via encoding and decoding when $F_E$ is large enough.
This further implies the worst-case entanglement fidelity
$F_E'(\Phi, \Psi)= \min_{\varphi_\rho} F( \Phi \otimes \mathds{1} (\varphi_\rho),  \Psi \otimes \mathds{1} (\varphi_\rho))$,
for $|\varphi_\rho\rangle$ as a purification of $\rho\in \C D(\C X)$, is also large enough.
This means that
using the purification $|\varphi_\rho\rangle$ to achieve its quantum capacity becomes redundant.
The property of a channel $\Phi$ is fully characterized by its Choi state $\omega_\Phi$.

The task of entanglement distribution is weaker than the entanglement generation~\cite{Dev05},
hence $Q_{ED}\leq Q_{EG}$.
However, it has been well established that
the quantum capacity $Q$ is equal to entanglement generation capacity $Q_{EG}$.
A careful look reveals that such an equivalence is relative to the set of entangled states
as assistance (or resource).
So it is a \emph{relativized} equivalence.
On the contrary, there is no such resource requirement for ED,
hence $Q=Q_{ED}$ is an exact or absolute equivalence.

The established proof of quantum coding theorem uses $I_c(\pi_d,\Phi)\leq Q_{EG}$~\cite{Wat18}.
Fortunately, its proof actually proves $I_c(\pi_d,\Phi)\leq Q_{ED}$,
so we can directly apply its method to prove $Q(\Phi)=I(\Phi)$.

\begin{theorem}
(Quantum capacity theorem)
Let $\Phi\in C(\C X, \C Y)$ be a channel, then $Q(\Phi)=I(\Phi)$.
\end{theorem}
\begin{proof}
By a close examination of Theorem 8.53~\cite{Wat18}, it proves $I(\Phi)\leq Q_{ED}(\Phi)$.
So to prove $I(\Phi)\geq Q_{ED}(\Phi)$,
let $\alpha$ and $\delta$ satisfy $Q_{ED}(\Phi)$, then
\begin{equation} H(\C D \Phi^{\otimes n} \C E \otimes \mathds{1}^{\otimes m} (\omega^{\otimes m}))\leq 2\delta m+1, \end{equation}
and
\begin{equation} H(\C D \Phi^{\otimes n} \C E (\mathds{1}^{\otimes m}))\leq m-\delta m-1, \end{equation}
so \begin{equation} I(\Phi) \geq (1-3\delta) \alpha -\frac{3}{n}, \end{equation}
which implies $I(\Phi)\geq Q(\Phi)=Q_{ED}(\Phi)$.
\end{proof}
Compared with the original quantum capacity formula $\lim_{n\rightarrow \infty}\frac{I_c(\Phi^{\otimes n})}{n}$,
this is a huge reduction.
It is due to two facts: the additivity of $I(\Phi)$ and the ED protocol.
We may name it the ``refined quantum capacity'';
however, for simplicity, we call it the quantum capacity in this work.
Also note the ED protocol is not the same as the EA setting studied later on.

The $I(\Phi)$ is additive and bounded as $|I(\Phi)| \leq \log d$.
It is invariant
$I(\Phi)=I(\C U \circ \Phi \circ \C V)$ for any isometry $\C U$ and $\C V$.
The values of it for some familiar channels are shown in Table~\ref{tab:cap-example}.

\begin{table}[]
    \centering
    \begin{tabular}{||c|c||} \hline
    channel & quantum capacity  \\ \hline
    replacement &  $-\log d$ \\ \hline
    isometry & $\log d$ \\ \hline
    AD ($d=2$) & $h(\frac{1+\gamma}{2})-h(\frac{\gamma}{2})$ \\ \hline
    unital & $\log d - H(p_i)$ \\ \hline
    erasure & $(1-2p)\log d$ \\ \hline
    dephasing & $\geq 0$ \\ \hline
    EB & $\leq 0$ \\ \hline
    \end{tabular}
    \caption{Quantum capacities of a few channels.
    Details are found in the appendix.}
    \label{tab:cap-example}
\end{table}

By quantum teleportation (QT)~\cite{BBC+93} and superdense coding (DC)~\cite{BW92},
we can treat a qubit as two bits: one bit for phase information (for Pauli $Z$),
and one bit for bit-value information (for Pauli $X$).
Given an ebit, we can send two bits by just sending one qubit via DC,
or send one qubit by just sending two bits via QT.
So for $Q\geq 0$, we can define a coherent classical capacity $C_\textsc{oh}=2Q$.

\begin{corollary}
(Coherent classical capacity) Let $\Phi\in C(\C X, \C Y)$ be a channel.
If $Q(\Phi) \geq 0$,
the coherent classical capacity is $C_\textsc{oh}(\Phi)=2Q(\Phi)$.
\end{corollary}

The quantum converse coding theorem proves that if the information rate $R> Q(\Phi)$,
then it is not possible to reliably transmit qubits.
With the refined capacity,
it is clear to see the strong converse coding theorem holds via the
quantum Gallager’s exponent formula~\cite{SW13}.

If $Q<0$, we can define a classical capacity $C$, which can only send commuting states,
and many others.
We cannot define an incoherent quantum capacity as $C/2$ since a quantum state
is not a mixture of an $X$ part and an $Z$ part.
This signifies the uniqueness of quantum entanglement,
which coherently combines the bit and phase information.

\section{Classical capacity}

To transmit classical bits over quantum channels,
Alice will use a quantum ensemble $\{p_i,\rho_i\}$ obtained by
a classical-to-quantum encoding $x_i \mapsto \rho_i$ to represent a
random variable $\text{X}=\{p_i, x_i\}$,
and Bob will do measurement and obtain a random variable Z~\footnote{Note here X and Z are merely symbols for classical random variables instead of Pauli operators.}.
For this setting, we find that the quantum ensemble is required as resources,
which, however, may be unnecessary.
Therefore, in a similar spirit with the quantum case,
we will require the encoding to be isometric so that $\{\rho_i\}$ is an orthogonal set.

\begin{definition}
(An ``orthogonal'' (ORT) ensemble) Let $\{\rho_i\}$ be a set of states with orthogonal supports,
 then $\{p_i, \rho_i\}$ is an ORT ensemble.
\end{definition}
We will restrict to ORT ensemble of pure states.
For a random variable $\text{X}=\{p_i, x_i\}$, a quantum encoding $|x_i\rangle$ of $x_i$,
and a channel $\Phi \in C(\C X, \C Y)$ we define
\begin{equation} \chi_\textsc{ort}(p_i,\Phi):=H(\sum_i p_i \Phi(|x_i\rangle \langle x_i|))-\sum_i p_i H(\Phi(|x_i\rangle \langle x_i|)), \end{equation}
which is the mutual information in the classical-quantum state
\begin{equation} \rho_{XY}=\sum_i p_i |x_i\rangle \langle x_i| \otimes \Phi(|x_i\rangle \langle x_i|), \end{equation}
and $\chi_\textsc{ort}(\Phi):=\max_{p_i} \chi_\textsc{ort}(p_i,\Phi)$.
It is clear to see $\chi_\textsc{ort}(\Phi)$ is additive
while the standard Holevo quantity $\chi(\Phi)$ is
known not to be, in general.

Now we can refine the notable Holevo-Schumacher-Westmoreland theorem
which established the classical capacity of a quantum channel
to be $\lim_{n\rightarrow \infty}\frac{\chi(\Phi^{\otimes n})}{n}$.
\begin{theorem}
(Classical capacity theorem)
Let $\Phi\in C(\C X, \C Y)$ be a channel, then $C(\Phi)=\chi_\textsc{ort}(\Phi)$.
\end{theorem}
\begin{proof}
As it is known $\chi(\Phi) \leq C(\Phi)$~\cite{Wat18} and $\chi_\textsc{ort}(\Phi)\leq \chi(\Phi)$,
so $\chi_\textsc{ort}(\Phi) \leq C(\Phi)$.
To prove $\chi_\textsc{ort}(\Phi) \geq C(\Phi)$, we use the same method
as that of Theorem 8.27~\cite{Wat18}
but only with incoherent ensemble $\{\frac{1}{2^m},{\bf b}_m\}$,
for bit-string ${\bf b}_m:=b_1\cdots b_m$,
and find the classical mutual information $I(\text{X}:\text{Z}) \leq n \chi_\textsc{ort}(\Phi)$,
which leads to $\chi_\textsc{ort}(\Phi) \geq C(\Phi)$.
\end{proof}
This reduction is due to the additivity of $\chi_\textsc{ort}(\Phi)$ and the usage of
orthogonal ensemble.
This is physically reasonable since
it is natural to treat a bit-string $x_i$
as a bit-string state $|x_i\rangle$,
and non-isometric encoding itself
will blur the message on the first hand.
Same as the classical case,
the optimization over $p_i$ is necessary since now
the channels do not need to preserve entanglement and the channel-state duality shall not apply.

For the set of channels that cannot distribute ebits,
they are yet at least as powerful as classical channels.
For any classical channel modeled as a stochastic map which is positive instead of completely positive,
it can be simulated by a POVM $\{F_j\}$ with
the stochastic matrix as $(\langle i|F_j|i\rangle)_{ij}$.
An input random variable is a diagonal state
$\rho=\sum_i p_i |i\rangle \langle i|$,
and the channel is simulated by a quantum-classical channel
\begin{equation} \Phi(\rho)=\sum_j \text{tr}(F_j \rho) |j\rangle \langle j|. \end{equation}
If the POVM is projective, then it simulates a doubly-stochastic map.
This also shows that EB channels can perform certain tasks
that may have an advantage over classical channels,
which we do not pursue here (see Ref.~\cite{Hay17}).

\section{Private capacity}

Based on $\chi_\textsc{ort}(\Phi)$, it is straightforward
to obtain an additive private capacity.
Let $\Delta\chi_\textsc{ort}(p_i, \Phi):=\chi_\textsc{ort}(p_i, \Phi)-\chi_\textsc{ort}(p_i, \Phi^c)$,
then we define an additive private capacity
\begin{equation} P(\Phi):=\max_{p_i} \Delta\chi_\textsc{ort}(p_i, \Phi), \end{equation}
for $\Phi^c$ as the complementary channel of $\Phi$.
It holds
\begin{equation} 0\leq P(\Phi)\leq C(\Phi). \end{equation}

Indeed, privacy is different from entanglement,
although entanglement is already a kind of privacy due to the uncertainty principle.
There are channels with zero quantum capacity but an arbitrarily large private capacity~\cite{LLS+14}.
Under the completely dephasing channel $\Delta$,
the ebit becomes the maximally classically-correlated state,
a ``debit.''
The key difference between them is that ebits allow the transmission of qubits.

\section{Entanglement-assisted setting}

We first refine the entanglement-assisted (EA) setting to only use ebits as the assistance
for encoding and decoding,
and then compare with the standard EA setting.

\begin{definition}
(``EA orthogonal'' (EAO) ensemble) Let $\{U_i\}$ be a set of orthogonal unitary operators.
Let $|\omega_{U_i}\rangle=U_i\otimes \mathds{1} |\omega\rangle$, then $\eta:=\{p_i, |\omega_{U_i}\rangle\}$ is an EAO ensemble.
\end{definition}
We now introduce
\begin{equation} \chi_\textsc{eao}(\eta,\Phi):= H(\sum_i p_i \Phi\otimes \mathds{1}(\omega_{U_i}))-\sum_i p_i H(\Phi\otimes \mathds{1}(\omega_{U_i})), \end{equation}
and $\chi_\textsc{eao}(\Phi):=\max_{p_i}\chi_\textsc{eao}(\eta,\Phi)$.
This can be viewed as encoding $x_i$ by a set of orthogonal unitary operators $U_i$.
It is clear that $\chi_\textsc{eao}(\Phi)$ is additive.
Recall that an EA ensemble can be more general:
the ebit $|\omega\rangle$ can be replaced by any bipartite pure state,
and the set of $U_i$ replaced by a set of channels~\cite{Wat18}.

With the same method for proving $\chi_\textsc{ort}(\Phi)$ while using EAO ensemble, it is clear to prove:
\begin{theorem}
(EAO-classical capacity theorem)
Let $\Phi\in C(\C X, \C Y)$ be a channel, then $C_\textsc{eao}(\Phi)=\chi_\textsc{eao}(\Phi)$.
\end{theorem}
Although $\chi_\textsc{eao}(\Phi)$ also involves an optimization over $p_i$,
it turns out this is unnecessary due to an intriguing relation between
$\chi_\textsc{ea}(\Phi)$ and coherent mutual information.
Note we use $\chi_\textsc{ea}$ to denote the usual EA Holevo quantity $\chi_E$ in this paper~\cite{Wat18}.

\begin{corollary}
Let $\Phi\in C(\C X, \C Y)$ be a channel, then $C_\textsc{eao}(\Phi)=\chi_\textsc{eao}(\Phi)=\log d+I(\Phi)$.
\end{corollary}
\begin{proof}
In Lemma 8.39 of Ref.~\cite{Wat18}, it proves
\begin{equation} \chi_\textsc{ea}(\Phi)\geq H(\pi_d)+I_c(\pi_d, \Phi) \end{equation}
for $\pi_d=\Pi/d$ and $d=\text{tr}(\Pi)$ and $\Pi$ is a projector.
The proof actually proves the stronger result
\begin{equation} \chi_\textsc{eao}(\Phi)\geq H(\pi_d)+I_c(\pi_d, \Phi) \end{equation}
as it uses a completely uniform ensemble of Bell states, $\eta_*$, which is an EAO ensemble.
Also it proves
\begin{equation} \chi_\textsc{eao}(\eta_*, \Phi)= \log  d+I(\Phi), \end{equation}
which is the equality between two mutual information quantities.

The Lemma 8.40~\cite{Wat18} also applies to any EAO ensemble $\eta_\textsc{eao}$ which becomes
\begin{equation} \chi_\textsc{ort}(\Phi\otimes \mathds{1} (\eta_\textsc{eao}))\leq \log d +I(\Phi). \end{equation}
This completes the proof.
\end{proof}

By QT and DC, we define \begin{equation} Q_\textsc{eao}(\Phi):=(\log d+ I(\Phi))/2. \end{equation}
This means that when $I(\Phi)<0$, yet with ebits we can recover its ability to transmit qubits
so that the whole channel ($\Phi$ assisted by ebits) is still quantum.
The information is still directly transmitted from $\Phi$ so can only be classical,
therefore, $\log d+I(\Phi)$ is an EAO classical capacity instead of quantum capacity.
It is clear to show $Q(\Phi)=I(\Phi)\leq Q_\textsc{eao}(\Phi)$ since $\log d\geq I(\Phi)$.

Actually, given $\Phi$, the optimal scheme to achieve $C_\textsc{eao}(\Phi)$ is the superdense coding,
which encodes bits into Pauli operators hence the set of ebits.
The decoding is formed by the decoder of $\Phi$ followed by Bell measurements.
Also, modular the ebit, a qubit is equivalent to two bits.
As QT converts a qubit into two bits,
so it can be viewed as an EAO scheme with $\Phi$ acting on the bit communication channel.
That is, QT is optimal to achieve $Q_\textsc{eao}(\Phi)$.

The standard EA setting uses more general entangled states as the assistance.
Importantly, the maximum coherent mutual information $J(\Phi)$ is additive.
There exists a gap between $\log d+ I(\Phi)$ and $J(\Phi)$ for some channel $\Phi$.
Achieving the maximum of $J(\rho,\Phi)$ by a state $\rho$
is to achieve the regularized EA Holevo capacity,
which shall require a highly-entangled state $\xi$ as a free assistance which is not a collection of ebits.
It is not easy to prepare and distribute such states, however.
This is similar with the situation for entanglement generation which also
assumes the free assistance of entangled states.
For our reduced case, we do not take them to be free assistance which is physically more reasonable.

Given a channel, to see if there is a gap between the EA and EAO settings is not easy.
Here we consider the class of CQ channels, which have negative quantum capacity.
For a CQ channel acting on the purification of a state $\rho=\sum_k p_k |k\rangle \langle k|$,
the mutual information is
\begin{equation} J(\rho,\Phi)=H(\sum_k p_k R_k)-\sum_k p_k H(R_k), \end{equation}
for a set of states $\{R_k\}$.
The EA classical capacity is $C_\textsc{ea}(\Phi)=\max_\rho J(\rho,\Phi)$ which is to optimize over $p_k$.
If $R_k:=\Psi(|k\rangle\langle k|)$, then it is easy to see $C_\textsc{ea}(\Phi)$ is the same as the classical capacity of $\Psi$
which is $\chi_\textsc{ort}(\Psi)$.
Indeed, to achieve optimal classical capacity,
the optimal input distribution is not always the uniform one.
Hence using $\varphi_\rho$ as a resource for EA setting is reasonable in this case.
For QC channels, the $\chi_\textsc{eao}$ is $\log d$,
so it is the optimal $\chi_\textsc{ea}$.
For channels with positive quantum capacity,
it is not clear how to find the optimal resource entangled states.

To conclude, we refined the settings of quantum communication in order to obtain additive capacities of quantum channels.
Surprisingly, it is straightforward to achieve additivity and the proof follows almost exactly the same as the original ones~\cite{Wat18}.
Besides, Renyi entropies are also well defined and widely used~\cite{Hay17},
as extensions of Shannon and von Neumann entropy.
It is clear that the classical and private capacities
can be extended to Renyi entropies.
However, the proofs for quantum and EA capacities rely on the strong subadditivity of the von Neumann entropy,
which is not satisfied by Renyi entropies in general,
so cannot be extended.
However, it remains to see if quantum Renyi entropies of special forms
can be used to define quantum and EA capacities.

\section{Acknowledgement}
This work has been funded by
the National Natural Science Foundation of China under Grants
12047503 and 12105343.