ACO intelligent task scheduling algorithm based on Q-learning optimization in a multilayer cognitive radio platformXie, Zongfu; Liu, Jinjin; Ji, Yawei; Li, Wanwan; Dong, Chunxiao; Yang, Bin
doi: 10.1177/00375497231208481pmid: N/A
With the rapid development of cognitive radio technology, multilayer heterogeneous cognitive radio computing platforms with large computing, high-throughput, ultralarge bandwidth and ultralow latency have become a research hotspot. Aiming at the core scheduling problems of multilayer heterogeneous computing platforms, this paper abstracts the bidirectional interconnection topology, node computing capacity, and internode communication capability of the heterogeneous computing platform into an undirected graph model and abstracts the nodes with dependencies, nodes’ computing requirements, and internode communication requirements in streaming tasks into a directed acyclic graph (DAG) model so as to transform the task-scheduling problem into a deployment-scheduling problem from DAG to undirected graph. To efficiently solve this graph model, this paper calculates and forms a component scheduling sequence based on the dependencies of functional components in streaming domain tasks. Then, according to the scheduling sequence, ant colony optimization (ACO) algorithms, such as ant colonies and Q-learning select functional components, deploy components to different computing nodes, calculate the scheduling cost, guide the solution space search of agents, and complete the scenario migration adaptation of the scheduling algorithms to intelligent scheduling of domain tasks. So, this paper proposes the ACO field task intelligent scheduling algorithm based on Q-learning optimization (QACO). QACO uses the Q-table matrix of Q-learning as the initial pheromone of the ant colony algorithm, which not only solves the dimensional disaster of the Q-learning algorithm but also accelerates the convergence speed of the ant colony intelligent scheduling algorithm, reduces the task scheduling length, and further enhances the search ability of the existing scheduling algorithm to solve the spatial set. Based on the randomly generated DAG domain task map, three experimental test scenarios are designed to verify the algorithm performance. The experimental results show that compared with the Q-learning, ACO, and genetic algorithms (GA) algorithms, the proposed algorithm improves the convergence speed of the solution by 72.3%, 63.4%, and 64% on average, reduces the scheduling length by 2.8%, 2.2%, and 0.9% on average, and increases the parallel acceleration ratio by 2.8%, 2.1%, and 0.9% on average, respectively. The practical application value of the algorithm is analyzed through typical radar task simulation, but the load balancing of the algorithm needs to be further improved.
Spatial iterative coordination for parallel simulation-based optimization of large-scale traffic signal controlTan, Wen Jun; Andelfinger, Philipp; Cai, Wentong; Eckhoff, David; Knoll, Alois
doi: 10.1177/00375497231159944pmid: N/A
Applying simulation-based optimization to city-scale traffic signal optimization can be challenging due to the large search space resulting in high computational complexity. A divide-and-conquer approach can be used to partition the problem and optimized separately, which leads to faster convergence. However, the lack of coordination among the partial solutions may yield a poor-quality global solution. In this paper, we propose a new method for simulation-based optimization of traffic signal control, called spatially iterative coordination for parallel optimization (SICPO), to improve coordination among the partial solutions and reduce synchronization between the partitioned regions. The traffic scenario is simulated to obtain the interactions, which is used to spatially decompose the scenario into regions and identify interdependencies between the regions. Based on the regions, the problem is divided into subproblems which are optimized separately. To coordinate between the subproblems, the interactions between partial solutions are synchronized in two ways. First, multiple iterations of the optimization process can be executed to coordinate the partial solutions at the end of each optimization process. Second, the partial solutions can also be coordinated among the regions by synchronizing the trips across the regions. To reduce computational complexity, parallelism can be applied on two levels: each region is optimized concurrently, and each solution for a region is evaluated in parallel. We demonstrate our method on a real-world road network of Singapore, where SICPO converges to an average travel time 21.6% faster than global optimization at 62.8× shorter wall-clock time.
Multiobjective building design optimization using an efficient adaptive Kriging metamodelLahmar, Salma; Maalmi, Mostafa; Idchabani, Rachida
doi: 10.1177/00375497231168630pmid: N/A
Multiobjective building design optimization is a challenging problem because it involves finding a set of solutions that simultaneously optimize multiple conflicting objectives. Simulations-based optimization is widely used, but it is a computationally expensive process in terms of time, as it requires a large number of evaluations of the objective functions. Metamodel-based optimization is an alternative to reduce the time-consuming simulations during the optimization process. Metamodels can approximate the building simulation model with analytical expressions. However, the accuracy of metamodels depends on the number of simulations used to train the model and the sampling strategy used to select informative samples over the design space. This study proposes an efficient sequential sampling approach to fit the metamodels toward the regions of the design space where their accuracy is higher and can improve all objectives simultaneously. To demonstrate the effectiveness of this approach, it was applied to optimize the energy and investment costs of a multi-story residential building. The optimization results were compared with those obtained using a non-dominated sorted genetic algorithm II (NSGA-II). The results of this study show that the proposed method reduces the number of building energy simulations required by up to 50% while guaranteeing accurate optimization results. Fifteen energy-efficient buildings designs were proposed, with a wide range of trade-offs between energy and investment costs. This study highlights the potential of the proposed approach to achieve faster and accurate building design optimization and allowing for a larger design space, leading to more creative and innovative solutions.
Reachability analysis of FMI models using data-driven dynamic sensitivityBogomolov, Sergiy; Gomes, Cláudio; Isasa, Carlos; Soudjani, Sadegh; Stankaitis, Paulius; Wright, Thomas
doi: 10.1177/00375497241261409pmid: 40225422
Digital twin is a technology that facilitates a real-time coupling of a cyber–physical system and its virtual representation. The technology is applicable to a variety of domains and facilitates more intelligent and dependable system design and operation, but it relies heavily on the existence of digital models that can be depended upon. In realistic systems, there is no single monolithic digital model of the system. Instead, the system is broken into subsystems, with models exported from different tools corresponding to each subsystem. In this paper, we focus on techniques that can be used for a black-box model, such as the ones implementing the Functional Mock-up Interface (FMI) standard, formal analysis, and verification. We propose two techniques for simulation-based reachability analysis of models. The first one is based on system dynamics, while the second one utilizes dynamic sensitivity analysis to improve the quality of the results. Our techniques employ simulations to obtain the model’s sensitivity with respect to the initial state (or model’s Lipschitz constant) which is then used to compute reachable states of the system. The approaches also provide probabilistic guarantees on the accuracy of the computed reachable sets that are based on simulations. Each technique requires different levels of information about the black-box system, allowing the readers to select the best technique according to the capabilities of the models. The validation experiments have demonstrated that our proposed algorithms compute accurate reachable sets of stable and unstable linear systems. The approach based on dynamic sensitivity provides an accurate and, with respect to system dimensions, more scalable approach, while the sampling-based method allows a flexible trade-off between accuracy and runtime cost. The validation results also show that our approaches are promising even when applied to nonlinear systems, especially, when applied to larger and more complex systems. The reproducibility package with code and data can be found at https://github.com/twright/FMI-Reachability-Reproducibility.
Hybrid resource allocation control in cyber-physical systems: a novel simulation-driven methodology with applications to UAVsPecker-Marcosig, Ezequiel; Giribet, Juan I; Castro, Rodrigo D
doi: 10.1177/00375497241313404pmid: N/A
Designing hybrid controllers for cyber-physical systems (CPSs) where computational and physical components influence each other is a challenging task, as it requires considering the performance of very different types of dynamics simultaneously. Meanwhile, controlling each of these dynamics separately can lead to unacceptable results. Common approaches to controller design rely on the use of analytical methods. Although this approach can provide formal guarantees of stability and performance, the analytical design of hybrid controllers can become quite cumbersome. Alternatively, modeling and simulation (M&S)-based design techniques have proven successful for hybrid controllers, providing robust results based on Monte Carlo techniques. This requires simulation models and platforms capable of seamlessly composing the underlying hybrid domains. Unmanned Aerial Vehicles (UAVs) are CPSs with sensitive physical–computational couplings. We address the development of a hybrid model and simulation platform for a data collection application involving UAVs with onboard data processing. The quality of control (QoC) of the physical dynamics must be ensured together with the quality of service (QoS) of the onboard software competing for scarce processing resources. In this scenario, it is imperative to find safe trade-offs between flight stability and processing throughput that can adapt to uncertain environments. The goal is to design a hybrid supervisory controller that dynamically adapts the use of resources to balance the performance of both aspects in a CPS, while ensuring system-level QoS. We present the end-to-end M&S-based design methodology, which can be regarded as a design template for a broader class of CPSs.