•An improved min-max dispatching method for grid-connected PV units was developed.•A control algorithm for short-term power dispatching was proposed.•The capacity and operation of battery energy ...storage system are optimized.•Efficient collaboration with the transmission system operator is realized.•High battery utilization is realized.
High uncertainty and large fluctuation of variable renewable energy create enormous challenges to planning and operation of integrated energy systems. To overcome these problems, this paper proposed an improved min-max dispatching method. In the meantime, a control algorithm for short-term power dispatching was proposed and implemented to smoothen the power dispatching between two neighboring dispatching intervals. The improved min-max dispatching method was applied to a 1 kW experimental PV system with real-time data. The optimal capacity of the battery energy storage system obtained by the improved min-max method is 40% smaller than the volume obtained by the modified min-max method. Regarding the operation of the BESS, the average depth of discharge is 0.5988, which is 7.06% higher than the operation performance with the alternative dispatching method. The results clearly indicate that improved min-max dispatching method is a very effective approach for managing grid-connected integrated energy systems and promoting penetration of variable renewable energies.
The rapid development of renewable energy and the continuous growth of peak load bring new challenges to the dispatching capacity of generation side. In view of the possible mismatch between power ...generation of renewable energy and the load, we propose an integrated optimal dispatching strategy model of power generation and consumption interaction in this paper. Among them, the generation side resources include wind power, photovoltaic and battery energy storage and the load side dispatching resources include transferable load, interruptible load and electric vehicles. The model takes the benefits of generation side and the benefits of load side as objectives. Moreover, three different dispatching orders are put forward, which are random dispatching, interruption and transfer of load before electric vehicles charging and discharging, electric vehicles charging and discharging before interruption and transfer of load. In addition, we propose seven different dispatching combinations based on the optimal dispatching order to analyse the response ability of different load side dispatching resources. Multi-objective Genetic Algorithm and the method of technique for order preference by similarity to an ideal solution are applied in this study to obtain the optimal results. It can be identified that the response ability of different load side dispatching resources is different, and the overall dispatching can improve the benefits of generation side and the benefits of load side. Meanwhile, the proposed strategy considers the willingness of the load to the greatest extent and effectively improves the utilization rate of wind and solar power generation.
A scheduling policy strongly influences the performance of a manufacturing system. However, the design of an effective scheduling policy is complicated and time consuming due to the complexity of ...each scheduling decision, as well as the interactions among these decisions. This paper develops four new multi-objective genetic programming-based hyperheuristic (MO-GPHH) methods for automatic design of scheduling policies, including dispatching rules and due-date assignment rules in job shop environments. In addition to using three existing search strategies, nondominated sorting genetic algorithm II, strength Pareto evolutionary algorithm 2, and harmonic distance-based multi-objective evolutionary algorithm, to develop new MO-GPHH methods, a new approach called diversified multi-objective cooperative evolution (DMOCC) is also proposed. The novelty of these MO-GPHH methods is that they are able to handle multiple scheduling decisions simultaneously. The experimental results show that the evolved Pareto fronts represent effective scheduling policies that can dominate scheduling policies from combinations of existing dispatching rules with dynamic/regression-based due-date assignment rules. The evolved scheduling policies also show dominating performance on unseen simulation scenarios with different shop settings. In addition, the uniformity of the scheduling policies obtained from the proposed method of DMOCC is better than those evolved by other evolutionary approaches.
•Design a hydrogen energy storage system-carbon capture and utilization system-based micro energy grid.•Proposed a carbon emission-green certificate equivalent interaction mechanism for multi-energy ...conversion and storage system.•Construct a two-stage optimal dispatching framework including day-ahead robust dispatching model and real-time rolling model.•Proposed an entropy-Shapley-based benefit allocation method considering multi-dimension impact factors.•Carried out the effectiveness and applicability analysis for the proposed dispatching scheme and benefit allocation strategy.
To fully utilize the abundant renewable energy resources in county-level areas of China, this paper designs a novel structure of micro-energy grid integrating hydrogen energy storage (HES) system and carbon capture and utilization (CCU) system (HES-CCU-based MEG). And a carbon emission-green certificate equivalent interaction mechanism is established. Then, a two-stage optimal dispatching framework is proposed for mitigating the impact of uncertainty variables, including a day-ahead robust dispatching model and a real-time rolling optimization model. Thirdly, an entropy-Shapley-based benefit allocation method is constructed to allocate the benefits in dimensions of energy conservation, carbon emission reduction, and renewable power consumption among various devices. Finally, a micro-energy grid in Henan province, China, is selected as an example for case study. The results show that: (1) HES could transfer surplus renewable power and low-priced power to periods with high power prices, while CCU could achieves the cycle and utilization of CO2, leading to a decrease in power purchase costs and carbon emissions by 7.85% and 0.47%, respectively. (2) The two-stage optimal dispatching model gives full play to the flexibility adjustment ability of each device, mitigates the deviations caused by uncertainty variables, and formulates the optimal dispatching strategy. (3) The entropy-Shapley-based benefit allocation method could evaluate the contributions of each device in different dimensions, effectively, ensuring the rationality of benefit allocation results. Overall, the proposed model and method could utilize renewable energy resources in county-level areas, which is better to promote the clean and low-carbon transformation of the overall energy structure.
Manufacturing is involved with complex job shop scheduling problems (JSP). In smart factories, edge computing supports computing resources at the edge of production in a distributed way to reduce ...response time of making production decisions. However, most works on JSP did not consider edge computing. Therefore, this paper proposes a smart manufacturing factory framework based on edge computing, and further investigates the JSP under such a framework. With recent success of some AI applications, the deep Q network (DQN), which combines deep learning and reinforcement learning, has showed its great computing power to solve complex problems. Therefore, we adjust the DQN with an edge computing framework to solve the JSP. Different from the classical DQN with only one decision, this paper extends the DQN to address the decisions of multiple edge devices. Simulation results show that the proposed method performs better than the other methods using only one dispatching rule.
Efficient truck dispatching is crucial for optimizing container terminal operations within dynamic and complex scenarios. Despite good progress being made recently with more advanced ...uncertainty-handling techniques, existing approaches still have generalization issues and require considerable expertise and manual interventions in algorithm design. In this work, we present deep reinforcement learning-assisted genetic programming hyper-heuristics (DRL-GPHH) and their ensemble variant (DRL-GPEHH). These frameworks utilize a reinforcement learning agent to orchestrate a set of auto-generated genetic programming (GP) low-level heuristics, leveraging the collective intelligence, ensuring advanced robustness and an increased level of automation of the algorithm development. DRL-GPEHH, notably, excels through its concurrent integration of a GP heuristic ensemble, achieving enhanced adaptability and performance in complex, dynamic optimization tasks. This method effectively navigates traditional convergence issues of deep reinforcement learning (DRL) in sparse reward and vast action spaces, while avoiding the reliance on expert-designed heuristics. It also addresses the inadequate performance of the single GP individual in varying and complex environments and preserves the inherent interpretability of the GP approach. Evaluations across various real port operational instances highlight the adaptability and efficacy of our frameworks. Essentially, innovations in DRL-GPHH and DRL-GPEHH reveal the synergistic potential of reinforcement learning and GP in dynamic truck dispatching, yielding transformative impacts on algorithm design and significantly advancing solutions to complex real-world optimization problems.
With the emerging concept of sharing-economy, shared electric vehicles (EVs) are playing a more and more important role in future mobility-on-demand traffic system. This article considers joint ...charging scheduling, order dispatching, and vehicle rebalancing for large-scale shared EV fleet operator. To maximize the welfare of fleet operator, we model the joint decision making as a partially observable Markov decision process (POMDP) and apply deep reinforcement learning (DRL) combined with binary linear programming (BLP) to develop a near-optimal solution. The neural network is used to evaluate the state value of EVs at different times, locations, and states of charge. Based on the state value, dynamic electricity prices and order information, the online scheduling is modeled as a BLP problem where the decision variables representing whether an EV will 1) take an order, 2) rebalance to a position, or 3) charge. We also propose a constrained rebalancing method to improve the exploration efficiency of training. Moreover, we provide a tabular method with proved convergence as a fallback option to demonstrate the near-optimal characteristics of the proposed approach. Simulation experiments with real-world data from Haikou City verify the effectiveness of the proposed method.
Vehicle dispatching in the mobility-as-a-service (MaaS) market has gradually become a situation of multi-service provider competition and coexistence. However, most existing research on vehicle ...dispatching with dynamic pricing for the MaaS market is still limited to single-service provider scenarios. In this paper, we propose an economic model that analyzes the vehicle dispatching service pricing and demand interactions between multiple mobility service providers (MSPs) and passengers, respectively. We formulate the vehicle dispatching service pricing and demand problem as a two-stage Stackelberg game under different pricing schemes, namely, independent pricing scheme (IPS) and competitive pricing scheme (CPS), considering the vehicle supply-demand relationship and market competition among the MSPs. The MSPs, as leaders, set their service pricing strategies first, and then the passengers, as the followers, determine their service demands. Due to the high-dimensional and complicated nature of the dynamic MaaS market environment, we develop a multi-agent deep reinforcement learning (MADRL) algorithm to achieve the Nash equilibrium (NE) of the formulated game, which indicates the optimal pricing and demand strategies for MSPs and passengers. Simulation results and analysis show that the proposed MADRL-based algorithm converges to the optimal solution and outperforms other benchmark schemes under both IPS and CPS in terms of maximizing MSPs' revenue and protecting passengers' benefits. Furthermore, the proposed MADRL-based algorithm under CPS improves MSPs' market attractiveness and long-term benefits, which encourages MSPs to participate in competitive vehicle dispatching in the MaaS market.
Plug-in electric vehicles (PEVs) are increasingly popular in the global trend of energy saving and environmental protection. However, the uncoordinated charging of numerous PEVs can produce ...significant negative impacts on the secure and economic operation of the power system concerned. In this context, a hierarchical decomposition approach is presented to coordinate the charging/discharging behaviors of PEVs. The major objective of the upper-level model is to minimize the total cost of system operation by jointly dispatching generators and electric vehicle aggregators (EVAs). On the other hand, the lower-level model aims at strictly following the dispatching instructions from the upper-level decision-maker by designing appropriate charging/discharging strategies for each individual PEV in a specified dispatching period. Two highly efficient commercial solvers, namely AMPL/IPOPT and AMPL/CPLEX, respectively, are used to solve the developed hierarchical decomposition model. Finally, a modified IEEE 118-bus testing system including 6 EVAs is employed to demonstrate the performance of the developed model and method.
PDF
