Hybrid Model of Adaptive Prioritization of Energy Resources in a Medical Facility under Critical Deficit Conditions
Abstract
This paper addresses a scientific and applied problem of ensuring the energy resilience of critical medical infrastructure operating under conditions of extreme resource scarcity and instability of external power supply caused by deliberate destruction of the energy system. Unlike conventional Building Energy Management Systems (BEMS), which are primarily focused on economic efficiency in stable environments, the proposed approach shifts the focus toward maximizing the autonomous operation time of life-support equipment.
The methodological foundation of the study is the development of a hybrid decentralized model for adaptive energy resource prioritization implemented within an Edge–Fog Computing architecture. This architectural design ensures full system autonomy: TinyML models deployed at the Edge level provide real-time anomaly detection, while strategic decision-making is performed by a Deep Reinforcement Learning (DRL) agent at the Fog node level, without reliance on cloud services. This eliminates a critical single point of failure and significantly enhances data privacy.
The scientific novelty of the work lies in the introduction of an ethically oriented reward function for a Deep Q-Network (DQN) agent, which mathematically formalizes the prioritization of the bioethical principles of Beneficence and Non-Maleficence through the integration of risk categories defined by the NFPA 99 standard. The model employs a hard prioritization mechanism in which the unconditional supply of critical loads prevails over patient comfort and operational costs, while also accounting for physical system constraints, such as minimum battery charge levels, by incorporating elements of Constrained Reinforcement Learning.
The proposed model was validated in the simulation environment HospitalEnergyEnv using the “Blackout-48” scenario. Comparative simulation results demonstrated that the proposed DQN agent maintained 100% operational availability of critical medical equipment throughout 48 hours of autonomous operation by proactively switching to a deep energy-saving mode. In contrast, traditional Greedy and Rule-Based algorithms depleted available resources at the 32nd and 41st hours, respectively, resulting in emergency power loss in the intensive care unit.
The practical significance of the obtained results lies in the development of a deployment-ready architecture for autonomous hospital energy systems capable of adaptively allocating limited resources during prolonged blackouts while ensuring patient safety in accordance with international standards.Keywords
Full Text:
PDF (Українська)References
Saleem A. A., Hassan M. M., Ali I. A. “Smart Homes Powered by Machine Learning: A Review.” 2022 IEEE International Conference on Computer Science and Software Engineering (CSASE), 2022, pp. 355–361. DOI: 10.1109/CSASE51777.2022.9759682; Link: IEEE Xplore.
El Husseini F., Noura H. N., Salman O., Chahine K. “Machine Learning in Smart Buildings: A Review of Methods, Challenges, and Future Trends.” Applied Sciences, 2025, 15(14): 7682. DOI: 10.3390/app15147682; Link: MDPI (Appl. Sci.).
Chakraborty A., Islam M., Shahriyar F., Islam S., Zaman H. U., Hasan M. “Smart Home System: A Comprehensive Review.” Journal of Electrical and Computer Engineering, 2023, 2023: 1–30. DOI: 10.1155/2023/7616683; Link: Hindawi/Wiley.
Latoń D., Grela J., Ożadowicz A. “Applications of Deep Reinforcement Learning for Home Energy Management Systems: A Review.” Energies, 2024, 17(24): 6420. DOI: 10.3390/en17246420; Link: MDPI (Energies).
Sikandar H. S., Waheed H., Tahir S., Malik S. U. R., Rafique W. “A Detailed Survey on Federated Learning Attacks and Defenses.” Electronics, 2023, 12(2): 260. DOI: 10.3390/electronics12020260; Link: MDPI (Electronics).
Thakur P., Goel S., Puthooran E. “Edge AI Enabled IoT Framework for Secure Smart Home Infrastructure.” Procedia Computer Science, 2024, 235: 3369–3378. DOI: 10.1016/j.procs.2024.04.317; Link: ScienceDirect.
Reis M. J. C. S., Serôdio C. “Edge AI for Real-Time Anomaly Detection in Smart Homes.” Future Internet, 2025, 17(4): 179. DOI: 10.3390/fi17040179; Link: MDPI (Future Internet).
Khan L. U. et al. “Recent Advancements in Federated Learning: State of the Art, Fundamentals, Principles, IoT Applications and Future Trends.” (Published in Future Internet 2024, 16(11): 415.) DOI: 10.3390/fi16110415; Link: MDPI (Future Internet).
Kushnarov M. O., Averin Y. S., Shostak I. V. “Gibridna model adaptivnoyi prioritezaciyi energetichnih resursiv medichnogo zakladu v umovah kritichnogo deficitu” (Hybrid Model of Adaptive Prioritization of a Medical Facility’s Energy Resources under Critical Deficit). KhAI (National Aerospace University), 2024. DOI: 10.32620/oikit.2025.105.19; Link: KhAI.
Jin M. et al. “An Online Reinforcement Learning-Based Energy Management Strategy for Microgrids With Centralized Control.” IEEE Transactions on Industry Applications, 2025, 61(1): 1501–1510. DOI: 10.1109/TIA.2024.3430264; Link: IEEE Xplore.
Mottahedi S. Reinforcement Learning Safe Reinforcement Learning Energy Management Systems Constrained Differentiable Cross-Entropy Method. Ph.D. Dissertation, Pennsylvania State University, 2022. DOI: N/A; Link: Penn State ETD.
Gholami A., Shekari T., Grijalva S. “Proactive Management of Microgrids for Resiliency Enhancement: An Adaptive Robust Approach.” IEEE Transactions on Sustainable Energy, 2019, 10(1): 470–480. DOI: 10.1109/TSTE.2017.2740433; Link: IEEE Xplore.
Nuno Silva. “MQTT vs. CoAP for IoT in Edge/Mesh Networks.” HiveMQ Blog, Oct. 18, 2022. Link: HiveMQ Blog.
Silva D., Carvalho L. I., Soares J., Sofia R. C. “A Performance Analysis of Internet of Things Networking Protocols: Evaluating MQTT, CoAP, OPC UA.” Applied Sciences, 2021, 11(11): 4879. DOI: 10.3390/app11114879; Link: MDPI (Appl. Sci.).
Avsystem (Contributor). “TinyML: Intelligence in Small Packages – Ultra-low Power Consumption, Real-time Inference.” IoT For All (Blog), Last Updated: Dec 2, 2024. Link: IoT For All.
Sugumar B. K. et al. “Empowering Resilient Hospital Microgrids in Gaza with a Novel Toolbox for Sustainable Energy Solutions.” 2024 IEEE 24th International Conference on Environment and Electrical Engineering (EEEIC) & I&CPS Europe, 2024, pp. 1–6 (Paper no. 1187). DOI: 10.1109/EEEIC/ICPSEurope61470.2024.10751299; Link: IEEE Xplore.
Peterson C. J., Van Bossuyt D. L., Giachetti R. E., Oriti G. “A method to model, analyze, and design military microgrids with the objective to improve their resilience in the face of disconnections from the larger electrical grid.” Systems (MDPI), 2021, 9(3): 69. DOI: 10.3390/systems9030069; Link: MDPI (Systems).
NFPA 110 – Standard for Emergency and Standby Power Systems (2022 Edition). National Fire Protection Association. (Covers performance requirements for emergency power in buildings based on system risk.) DOI: N/A; Link: NFPA Official Page.
HITRUST Alliance. “The Ethics of AI in Healthcare: Safety and Liability, Patient Privacy, Transparency and Accountability.” (HITRUST AI Ethics content, summarized in Meditab Blog). DOI: N/A; Link: Meditab Blog (citing HITRUST).
Nuno Silva. “The Ethical and Social Implications of Using AI for Energy Management.” Energy Central (Intelligent Utility), 2023. Link: Energy Central.
UPB-LEA Group. OpenModelica Microgrid Gym (OMG) Toolbox. GitHub Repository, 2020–2023. Link: GitHub – upb-lea/openmodelica-microgrid-gym.
Prism Sustainability Directory. “Fundamental Categories of Grid Resilience Metrics.” Prism – Sustainability Directory (Scenario Term), 2025. Link: Prism Directory.
Achiam J., Held D., Tamar A., Abbeel P. “Constrained Policy Optimization (CPO).” Proceedings of ICML, 2017, pp. 22–31. DOI: N/A (preprint available). Link: ResearchGate.
Yuan X. (Jenny) et al. “Ethical Frameworks for Resource Allocation in Disaster Scenarios (AI4People framework).” Safety (MDPI), 2023, 5(3): 21. DOI: 10.3390/safety5030021; Link: MDPI (Safety).
Zhao B. et al. “Deep Reinforcement Learning Microgrid Energy Scheduling Problem.” PubMed Central (NIH), 2022, PMC8950638. DOI: N/A; Link: PMC Article.
Zhao B. et al. “Conventionally, the state of a MDP represents the information or observation… (on MDP State Representation).” Journal of Artificial Intelligence Research, 2023. DOI: N/A; Link: arXiv preprint.
NFPA 99 – Health Care Facilities Code (2021 Edition). National Fire Protection Association. (Defines risk-based categories of health care facility systems based on patient/staff risk.) DOI: N/A; Link: NFPA 99 Overview.
Shengren H., Fu A., Salazar E. M., Palensky P., Chen Q., Vergara P. P. “DistFlow Safe Reinforcement Learning (DF-SRL) for Real-Time Voltage Magnitude Regulation in Distribution Networks.” IEEE PES Conference Paper / Journal of Modern Power Systems, 2024 (to appear in Vol. 13, No. 1, pp. 300–311). DOI: 10.35833/MPCE.2024.000253; Link: TU Delft Repository.
DOI: https://doi.org/10.32620/oikit.2026.107.16
Refbacks
- There are currently no refbacks.
