You are presented with multiple paper abstracts, alongside the associated literature review and chapter titles. Given the provided information, you are going to do a literature review. Please generate a coherent literature review that synthesizes the content, draws connections between different works, highlights major findings, and identifies any gaps in the existing research.

Literature Review Title: No Peek: A Survey of private distributed deep learning 
Chapter Title:  Computational Goals 
1. Abstract of Cited Paper (BIB001):  In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of neural network-based systems, we propose a new technique to train deep neural networks over several data sources. Our method allows for deep neural networks to be trained using data from multiple entities in a distributed fashion. We evaluate our algorithm on existing datasets and show that it obtains performance which is similar to a regular neural network trained on a single machine. We further extend it to incorporate semi-supervised learning when training with few labeled samples, and analyze any security concerns that may arise. Our algorithm paves the way for distributed training of deep neural networks in data sensitive applications when raw data may not be shared directly. 
2. Abstract of Cited Paper (BIB002):  We propose an approach for solving Visual Teach and Repeat tasks for routes that consist of discrete directions along path networks using deep learning. Visual paths are specified by a single monocular image sequence and our approach does not query frames or image features during inference, but instead is composed of classifiers trained on each path. Our method is efficient for both storing or following paths and enables sharing of visual path specifications between parties without sharing visual data explicitly. We evaluate our approach in a simulated environment, and present qualitative results on real data captured with a smartphone.

Literature Review:
It is also quite important that any mechanism that aims to protect these details also preserves utility of the model above an acceptable level. These goals are to be ideally achieved at a low cost with regards to 1. Memory 2. Computational time 3. Communications bandwidth 4. Synchronization As shown in Fig 1. below smaller hospitals or tele-healthcare screening centers do not acquire an enormous number of diagnostic images and they could also be limited by diagnostic manpower. A distributed machine learning method for diagnosis in this setting should ideally not share any raw data (no peek) and at same time achieve high accuracy while using significantly lower resources. This helps smaller hospitals to effectively serve those in need while benefiting from decentralized entities. Table 1 : This is a survey of distributed deep learning methods with decreasing levels of leakage from distributed NN to splitNN. Hybrid approaches of these techniques and differential privacy, homomorphic encryption and MPC are also included. The citations for these 9 groups have been grouped separately with subtitles in the references section for convenience. In federated learning and large batch synchronous SGD, the architecture and parameters are shared between the client and server along with intermediate representations of the model that include the gradients, activations and weight updates which are shared during the learning process. Although the data is not explicitly shared in raw form in these two techniques, works like BIB001 have shown that raw data can be reconstructed up to an approximation by adversaries, especially given the fact that the architecture and parameters are not completely protected. SplitNN BIB002 has an added advantage in this context in that it does not share the architecture and weights of the model. The protection offered by splitNN lies in the compact representations found in deeper layers of neural networks and the difficulty of recovering the underlying data from these representations without knowing the model weights used to produce them. Such representations form after passing the data through numerous activations whose inverse in the case of ReLU are nonlinear and ill-defined (the inverse of a zero-valued ReLU can map to any negative number). Such representations have been shown to preserve information important for certain tasks (path following BIB003 resources required such as computations, communication bandwidth, memory and synchronization. We categorize the techniques across these dimensions as having low, medium and high requirements. As shown, splitNN requires the lowest resources on the client side. This is because the architecture is cut (arbitrary shape and not necessarily vertical) at a layer where the computations are only performed up to that cut on the client side. The rest of the computations happen on the server side. The experimental results in BIB002 , quantify these comparisons.