Prior Internet designs encompassed the fixed, mobile, and lately the "things" Internet. In a natural evolution to these, the notion of the Tactile Internet is emerging, which allows one to transmit ...touch and actuation in real-time. With voice and data communications driving the designs of the current Internets, the Tactile Internet will enable haptic communications, which in turn will be a paradigm shift in how skills and labor are digitally delivered globally. Design efforts for both the Tactile Internet and the underlying haptic communications are in its infancy. The aim of this article is thus to review some of the most stringent design challenges, as well as propose first avenues for specific solutions to enable the Tactile Internet revolution.
As a new way to design, deploy, and manage network services, network functions virtualization (NFV) decouples the network functions, from one or more physical network infrastructures and black boxes ...so they can run in software. It therefore comes as no surprise that NFV originated from service providers, who were looking to improve the deployment of new network services to support their revenue and growth objectives. Within the NFV ecosystem, high availability, and low latency are one of the key quality of service (QoS) benefits that service providers can expect from the 5G Cloud and the NFV networks to make delay-critical services such as remote surgery a reality. Therefore, network services should be placed, chained, and routed through the network considering users/tenants stringent QoS and service-level agreement requirements. To this end, routing and placement optimization plays a major role in improving network performance and the overall network cost. In this paper, we study the problem of virtual network functions (VNFs) placement and routing across the physical hosts to minimize overall latency defined as the queuing delay within the edge clouds and in network links. In that respect, this paper takes a holistic view by considering not only VNFs chaining and placement problem but also considering the flows routing aspect since these two problems are inter-related and have a major impact on network latency.
Machine-to-machine (M2M) communications enables networked devices to exchange information among each other as well as with business application servers and therefore creates what is known as the ...Internet-of-Things (IoT). The research community has a consensus for the need of a standardized protocol stack for M2M communications. On the other hand, cognitive radio technology is very promising for M2M communications due to a number of factors. It is expected that cognitive M2M communications will be indispensable in order to realize the vision of IoT. However cognitive M2M communications requires a cognitive radio-enabled protocol stack in addition to the fundamental requirements of energy efficiency, reliability, and Internet connectivity. The main objective of this paper is to provide the state of the art in cognitive M2M communications from a protocol stack perspective. This paper covers the emerging standardization efforts and the latest developments on protocols for cognitive M2M networks. In addition, this paper also presents the authors' recent work in this area, which includes a centralized cognitive medium access control (MAC) protocol, a distributed cognitive MAC protocol, and a specially designed routing protocol for cognitive M2M networks. These protocols explicitly account for the peculiarities of cognitive radio environments. Performance evaluation demonstrates that the proposed protocols not only ensure protection to the primary users (PUs) but also fulfil the utility requirements of the secondary M2M networks.
Integrating unmanned aerial vehicles (UAVs) into existing cellular networks encounters lots of challenges, among which one of the most striking concerns is how to achieve harmonious coexistence of ...aerial transceivers, inter alia, UAVs, and terrestrial user equipments (UEs). In this paper, a cellular-connected UAV network is focused, where multiple UAVs receive messages from base stations (BSs) in the down-link, while BSs are serving ground UEs in their cells. For effectively managing inter-cell interferences (ICIs) among UEs due to intense reuse of time-frequency resource block (RB) resource, a first p-tier based RB coordination criterion is proposed and adopted. Then, to enhance wireless transmission quality for UAVs while protecting terrestrial UEs from being interfered by ground-to-air (G2A) transmissions, a radio resource management (RRM) problem of joint dynamic RB coordination and time-varying beamforming design minimizing UAV's ergodic outage duration (EOD) is investigated. To cope with conventional optimization techniques' inefficiency in solving the formulated RRM problem, a deep reinforcement learning (DRL)-aided solution is initiated, where deep double duelling Q network (D3QN) and twin delayed deep deterministic policy gradient (TD3) are invoked to deal with RB coordination in discrete action domain and beamforming design in continuous action regime, respectively. The hybrid D3QN-TD3 solution is trained via interacting with the considered outer and inner environments in an online centralized manner so that it can then help achieve the suboptimal EOD minimization performance during its offline decentralized exploitation. Simulation results have illustrated the effectiveness of the proposed hybrid D3QN-TD3 algorithm, compared to several representative baselines.
Reinforcement learning (RL) is a widely investigated intelligent algorithm and proved to be useful in the wireless communication area. However, for optimization problems in large-scale multi-cell ...networks whose dimension increases exponentially, it is unrealistic to employ a conventional centralized RL algorithm and make decisions for the entire network. Multi-agent RL, which allows distribute decision-making, is expected to solve the scalability problem but with performance issues due to the unknown global information, i.e., non-stationary environment. In this paper, we propose a parameter-sharing multi-agent RL for grouping decisions of coordinated multi-point in a large-scale network, where agents jointly serve users to enhance the cell-edge service. By sharing information via parameters, our theoretical and simulation results show that parameter sharing can largely benefit the multi-agent algorithm with convergence proof and convergence speed analysis. To reduce the effect of biased local heterogeneous experience, we also propose a transfer learning method for the parameter sharing process, whose performance of transfer learning algorithms is verified by the simulation results.
Over the last few years, data traffic over cellular networks has seen an exponential rise, primarily due to the explosion of smartphones, tablets, and laptops. This increase in data traffic on ...cellular networks has caused an immediate need for offloading traffic for optimum performance of both voice and data services. As a result, different innovative solutions have emerged to manage data traffic. Some of the key technologies include Wi-Fi, femtocells, and IP flow mobility. The growth of data traffic is also creating challenges for the backhaul of cellular networks; therefore, solutions such as core network offloading and media optimization are also gaining popularity. This article aims to provide a survey of mobile data offloading technologies including insights from the business perspective as well.
In cellular-connected unmanned aerial vehicle (UAV) network, a minimization problem on the weighted sum of time cost and expected outage duration is considered. Taking advantage of UAV's adjustable ...mobility, a UAV navigation approach is formulated to achieve the aforementioned optimization goal. Conventional offline optimization techniques suffer from inefficiency in accomplishing the formulated UAV navigation task due to the practical consideration of local building distribution and directional antenna radiation pattern. Alternatively, after mapping the navigation task into a Markov decision process (MDP), a deep reinforcement learning (DRL)-aided solution is proposed to help the UAV find the optimal flying direction within each time slot, and thus the designed trajectory towards the destination can be generated. To help the DRL agent commit a better trade-off between sampling priority and diversity, a novel quantum-inspired experience replay (QiER) framework is proposed, via relating experienced transition's importance to its associated quantum bit (qubit) and applying Grover iteration based amplitude amplification technique. Compared to several representative DRL-related and non-learning baselines, the effectiveness and supremacy of the proposed DRL-QiER solution are demonstrated and validated in numerical results.
To enhance transmission performance, privacy level, and energy manipulating efficiency of wireless networks, this article initiates a novel simultaneous wireless information and power transfer ...(SWIPT) full-duplex (FD) relaying protocol, named harvest-and-opportunistically-relay (HOR). Due to the FD characteristics, the dynamic fluctuation of relay's residual energy is difficult to quantify and track. To solve this problem, the Markov Chain (MC) theory is invoked. Furthermore, to improve the privacy level of the proposed HOR relaying system, covert transmission performance analysis is performed, where closed-form expressions of the optimal detection threshold and minimum detection error probability are derived. Last but not least, with the aid of stationary distribution of the MC, closed-form expression of transmission outage probability is calculated, based on which transmission outage performance is analyzed. Numerical results have validated the correctness of analyses on transmission outage and covertness. The impacts of key system parameters on the performance of transmission outage and covertness are given and discussed. Based on mathematical analysis and numerical results, we showcase that the proposed HOR model can not only reliably enhance the transmission performance via smartly managing residual energy but also efficiently improve the privacy level of the legitimate transmission party via dynamically adjusting the optimal detection threshold.
It is expected that the use of cognitive radio for smart grid communication will be indispensable in near future. Recently, IETF has standardized RPL (routing protocol for low power and lossy ...networks), which is expected to be the standard routing protocol for majority of applications including advanced metering infrastructure (AMI) networks. Our objective in this paper is to enhance RPL for cognitive radio enabled AMI networks. Our enhanced protocol provides novel modifications to RPL in order to address the routing challenges in cognitive radio environments along with protecting the primary users as well as meeting the utility requirements of secondary network. System level performance evaluation shows the effectiveness of proposed protocol as a viable solution for practical cognitive AMI networks.
How to prolong network lifetime has become an important issue in the design of large scale wireless sensor networks (WSNs). In this paper, a novel power saving scheme for conventional WSNs via ...simultaneous wireless information and power transfer (SWIPT) based relays is proposed. Unlike conventional relays based communications need extra energy supply for data forwarding, the relay applied in this paper works in an energy-free manner with the support of SWIPT. The power saving model with both power splitting (PS) and time switching (TS) based SWIPT are proposed. Then, we formulate the joint power allocation and splitting problems of SWIPT relay assisted WSNs as non-convex constrained optimization problems. Since the formulated problems are non-convex, semi-positive definite programming (SDP) algorithms are proposed to find the joint optimization on power allocation and splitting with low complexity. The simulation results show that the PS model has more advantages than the traditional direct communication model in long distance transmission. Under the same information receiving strategy, the PS model outperforms the TS model.