Multi-Agent Reinforcement Learning (MARL) has emerged as an important approach for coordinating collaborative robots in industrial automation, warehouse logistics, healthcare, autonomous vehicles, and distributed robotic systems. Traditional centralized robot coordination methods faced limitations such as poor scalability, low adaptability, synchronization issues, and weak fault tolerance in dynamic environments. MARL overcomes these challenges through decentralized learning, where multiple robotic agents interact with the environment, learn from rewards, and improve coordination strategies autonomously. Before 2019, MARL gained significant attention in applications like cooperative navigation, formation control, multi-robot exploration, task allocation, path planning, collision avoidance, and resource sharing. This survey reviews key MARL techniques including Q-learning, Deep Q-Networks (DQN), policy-gradient methods, actor-critic models, and cooperative game-theoretic approaches for robotic coordination. The study explains a structured MARL coordination framework involving environment modeling, state representation, reward optimization, agent communication, and distributed decision-making. Experimental results show that MARL-based robotic systems improve task efficiency, coordination accuracy, energy optimization, adaptability, and collision reduction compared to centralized or heuristic methods. However, challenges such as communication delays, scalability, reward sparsity, non-stationary environments, and convergence instability still remain. The paper concludes that MARL is a promising solution for future intelligent collaborative robotics and highlights future research directions including federated reinforcement learning, explainable AI, edge-based robotic intelligence, and adaptive swarm robotics for Industry 4.0 applications.
Suresh Babu Reddy, Anita Verma· International Journal of Int...· 0 citations
Rapid urbanization and the demand for energy-efficient buildings have driven the need for intelligent HVAC systems. Traditional systems rely on fixed or manual controls, limiting their ability to adapt to changing environmental and occupancy conditions. This paper presents a Smart HVAC system that integrates Artificial Intelligence (AI), Internet of Things (IoT) sensors, cloud-based analytics, and machine learning to enhance energy efficiency, thermal comfort, and reliability. The proposed system continuously monitors indoor conditions such as temperature, humidity, air quality, and occupancy in real time. It applies supervised learning for temperature prediction and reinforcement learning for adaptive control, enabling optimized HVAC operations based on both historical and real-time data. The architecture includes data acquisition, preprocessing, model training, and intelligent control, with considerations for scalability, security, and interoperability. Performance evaluation through simulations and real-world testing demonstrates significant energy savings, reduced carbon emissions, and improved occupant comfort compared to conventional systems. Additionally, the system supports fault detection, predictive maintenance, and reduced downtime. Overall, this work contributes to smart building development by providing an efficient, scalable AI-driven HVAC framework that promotes sustainable and cost-effective building management.
Suresh Babu Reddy· International Journal of Mod...· 0 citations