2024 : 10 : 6
Parham Moradi

Parham Moradi

Academic rank: Associate Professor
ORCID:
Education: PhD.
ScopusId: 654
HIndex:
Faculty: Faculty of Engineering
Address: Department of Computer Engineering, Faculty of Engineering, University of Kurdistan
Phone:

Research

Title
A Local Graph Clustering Algorithm for Discovering Subgoals in Reinforcement Learning
Type
Presentation
Keywords
Hierarchical Reinforcement Learning, Option, Skill Acquisition,Subgoal Discovery, Graph Clustering.
Year
2010
Researchers Negin Entezari ، Mohammad Ebrahim Shiri ، Parham Moradi

Abstract

Reinforcement Learning studies the problem of learning through in-teraction with the unknown environment. Learning efficiently in large scale problems and complex tasks demands a decomposition of the original complex task to simple and smaller subtasks. In this paper a local graph clustering algo-rithm is represented for discovering subgoals. The main advantage of the pro-posed algorithm is that only the local information of the graph is considered to cluster the agent state space. Subgoals discovered by the algorithm are then used to generate skills. Experimental results show that the proposed subgoal discovery algorithm has a dramatic effect on the learning performance.