Splitting algorithm for DMT optimal cooperative MAC protocols in wireless mesh networks

A cooperative protocol for wireless mesh networks is proposed in this paper. The protocol implements both on-demand relaying and a selection of the best relay terminal so only one terminal is relaying the source message when cooperation is needed. Two additional features are also proposed. The best relay is selected with a splitting algorithm. This approach allows fast relay selection within less than three time-slots, on average. Moreover, a pre-selection of relay candidates is performed prior to the splitting algorithm. Only terminals that are able to improve the direct path are pre-selected. So efficient cooperation is now guaranteed. We prove that this approach is optimal in terms of diversity-multiplexing trade-off. The protocol has been designed in the context of Nakagami-mfading channels. Simulation results show that the performance of the splitting algorithm does not depend on channel statistics

On Security and reliability using cooperative transmissions in sensor networks

Cooperative transmissions have received recent attention and research papers have demonstrated their benefits for wireless networks. Such benefits include improving the reliability of links through diversity and/or increasing the reach of a link compared to a single transmitter transmitting to a single receiver (single-input single-output or SISO). In one form of cooperative transmissions, multiple nodes can act as virtual antenna elements and provide diversity gain or range improvement using space-time coding. In a multi-hop ad hoc or sensor network, a source node can make use of its neighbors as relays with itself to reach an intermediate node with greater reliability or at a larger distance than otherwise possible. The intermediate node will use its neighbors in a similar manner and this process continues till the destination is reached. Thus, for the same reliability of a link as SISO, the number of hops between a source and destination may be reduced using cooperative transmissions as each hop spans a larger distance. However, the presence of ma-licious or compromised nodes in the network impacts the benefits obtained with cooperative transmissions. Using more relays can increase the reach of a link, but if one or more relays are malicious, the transmission may fail. However, the relationships between the number of relays, the number of hops, and success probabilities are not trivial to determine. In this paper, we analyze this problem to understand the conditions under which cooperative transmissions fare better or worse than SISO transmissions. We take into consideration additional parameters such as the path-loss exponent and provide a framework that allows us to evaluate the conditions when cooperative transmissions are better than SISO transmissions. This analysis provides insights that can be employed before resorting to simulations or experimentation. © Springer Science+Business Media, LLC 2012

Deep Q-learning from Demonstrations

Deep reinforcement learning (RL) has achieved several high profile successes in difficult decision-making problems. However, these algorithms typically require a huge amount of data before they reach reasonable performance. In fact, their performance during learning can be extremely poor. This may be acceptable for a simulator, but it severely limits the applicability of deep RL to many real-world tasks, where the agent must learn in the real environment. In this paper we study a setting where the agent may access data from previous control of the system. We present an algorithm, Deep Q-learning from Demonstrations (DQfD), that leverages small sets of demonstration data to massively accelerate the learning process even from relatively small amounts of demonstration data and is able to automatically assess the necessary ratio of demonstration data while learning thanks to a prioritized replay mechanism. DQfD works by combining temporal difference updates with supervised classification of the demonstrator's actions. We show that DQfD has better initial performance than Prioritized Dueling Double Deep Q-Networks (PDD DQN) as it starts with better scores on the first million steps on 41 of 42 games and on average it takes PDD DQN 83 million steps to catch up to DQfD's performance. DQfD learns to out-perform the best demonstration given in 14 of 42 games. In addition, DQfD leverages human demonstrations to achieve state-of-the-art results for 11 games. Finally, we show that DQfD performs better than three related algorithms for incorporating demonstration data into DQN.Comment: Published at AAAI 2018. Previously on arxiv as "Learning from Demonstrations for Real World Reinforcement Learning

Novel precoded relay-assisted algorithm for cellular systems

Cooperative schemes are promising solutions for cellular wireless systems to improve system fairness, extend coverage and increase capacity. The use of relays is of significant interest to allow radio access in situations where a direct path is not available or has poor quality. A data precoded relay-assisted scheme is proposed for a system cooperating with 2 relays, each equipped with either a single antenna or 2-antenna array. However, because of the half-duplex constraint at the relays, relaying-assisted transmission would require the use of a higher order constellation than in the case when a continuous link is available from the BS to the UT. This would imply a penalty in the power efficiency. The simple precoding scheme proposed exploits the relation between QPSK and 16-QAM, by alternately transmitting through the 2 relays, achieving full diversity, while significantly reducing power penalty. Analysis of the pairwise error probability of the proposed algorithm with a single antenna in each relay is derived and confirmed with numerical results. We show the performance improvements of the precoded scheme, relatively to equivalent distributed SFBC scheme employing 16-QAM, for several channel quality scenarios. Copyright © 2010 Sara Teodoro, et al.European project CODIVPortuguese project CADWINPortuguese project AGILEFC

Novel precoded relay-assisted algorithm for cellular systems

Cooperative schemes are promising solutions for cellular wireless systems to improve system fairness, extend coverage and increase capacity. The use of relays is of significant interest to allow radio access in situations where a direct path is not available or has poor quality. A data precoded relay-assisted scheme is proposed for a system cooperating with 2 relays, each equipped with either a single antenna or 2-antenna array. However, because of the half-duplex constraint at the relays, relaying-assisted transmission would require the use of a higher order constellation than in the case when a continuous link is available from the BS to the UT. This would imply a penalty in the power efficiency. The simple precoding scheme proposed exploits the relation between QPSK and 16-QAM, by alternately transmitting through the 2 relays, achieving full diversity, while significantly reducing power penalty. Analysis of the pairwise error probability of the proposed algorithm with a single antenna in each relay is derived and confirmed with numerical results. We show the performance improvements of the precoded scheme, relatively to equivalent distributed SFBC scheme employing 16-QAM, for several channel quality scenarios. Copyright © 2010 Sara Teodoro, et al.European project CODIVPortuguese project CADWINPortuguese project AGILEFC

Data-precoded algorithm for multiple-relay-assisted systems

A data-precoded relay-assisted (RA) scheme is proposed for a system cooperating with multiple relay nodes (RNs), each equipped with either a single-antenna or a two-antenna array. The classical RA systems using distributed space-time/frequency coding algorithms, because of the half-duplex constraint at the relays, require the use of a higher order constellation than in the case of a continuous link transmission from the base station to the user terminal. This implies a penalty in the power efficiency. The proposed precoding algorithm exploits the relation between QPSK and 4 L -QAM, by alternately transmitting through L relays, achieving full diversity, while significantly reducing power penalty. This algorithm explores the situations where a direct path (DP) is not available or has poor quality, and it is a promising solution to extend coverage or increase system capacity. We present the analytical derivation of the gain obtained with the data-precoded algorithm in comparison with distributed space-frequency block code (SFBC) ones. Furthermore, analysis of the pairwise error probability of the proposed algorithm is derived and confirmed with numerical results. We evaluate the performance of the proposed scheme and compare it relatively to the equivalent distributed SFBC scheme employing 16-QAM and non-cooperative schemes, for several link quality scenarios and scheme configurations, highlighting the advantages of the proposed scheme

Novel precoded relay-assisted algorithm for cellular systems

Cooperative schemes are promising solutions for cellular wireless systems to improve system fairness, extend coverage and increase capacity. The use of relays is of significant interest to allow radio access in situations where a direct path is not available or has poor quality. A data precoded relay-assisted scheme is proposed for a system cooperating with 2 relays, each equipped with either a single antenna or 2-antenna array. However, because of the half-duplex constraint at the relays, relaying-assisted transmission would require the use of a higher order constellation than in the case when a continuous link is available from the BS to the UT. This would imply a penalty in the power efficiency. The simple precoding scheme proposed exploits the relation between QPSK and 16-QAM, by alternately transmitting through the 2 relays, achieving full diversity, while significantly reducing power penalty. Analysis of the pairwise error probability of the proposed algorithm with a single antenna in each relay is derived and confirmed with numerical results. We show the performance improvements of the precoded scheme, relatively to equivalent distributed SFBC scheme employing 16-QAM, for several channel quality scenarios. Copyright © 2010 Sara Teodoro, et al.European project CODIVPortuguese project CADWINPortuguese project AGILEFC

Ultra-Short Pulse Biphoton Source in Lithium Niobate Nanophotonics at 2\text{\mu}m

Photonics offers unique capabilities for quantum information processing (QIP) such as room-temperature operation, the scalability of nanophotonics, and access to ultrabroad bandwidths and consequently ultrafast operation. Ultrashort-pulse sources of quantum states in nanophotonics are an important building block for achieving scalable ultrafast QIP, however, their demonstrations so far have been sparse. Here, we demonstrate a femtosecond biphoton source in dispersion-engineered periodically poled lithium niobate nanophotonics. We measure 17 THz of bandwidth for the source centered at 2.09 \textmu m, corresponding to a few optical cycles, with a brightness of 8.8 GHz/mW. Our results open new paths towards realization of ultrafast nanophotonic QIP