Curriculum learning for heterogeneous star network embedding via deep reinforcement learning

Qu, Meng

Permalink

https://hdl.handle.net/2142/101634 Copy

Description

Title

Curriculum learning for heterogeneous star network embedding via deep reinforcement learning

Author(s)

Qu, Meng

Issue Date

2018-05-01

Director of Research (if dissertation) or Advisor (if thesis)

Han, Jiawei

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

Curriculum Learning Network Embedding Reinforcement Learning

Abstract

Learning node representations for networks has attracted much attention recently due to its effectiveness in a variety of applications. This paper focuses on learning node representations for heterogeneous star networks, which have a center node type linked with multiple attribute node types through different types of edges. In heterogeneous star networks, we observe that the training order of different types of edges affects the learning performance significantly. Therefore we study learning curricula for node representation learning in heterogeneous star networks, i.e., learning an optimal sequence of edges of different types for the node representation learning process. We formulate the problem as a Markov decision process, with the action as selecting a specific type of edges for learning or terminating the training process, and the state as the sequence of edge types selected so far. The reward is calculated as the performance on external tasks with node representations as features, and the goal is to take a series of actions to maximize the cumulative rewards. We propose an approach based on deep reinforcement learning for this problem. Our approach leverages LSTM models to encode states and further estimate the expected cumulative reward of each state-action pair, which essentially measures the long-term performance of different actions at each state. Experimental results on real-world heterogeneous star networks demonstrate the effectiveness and efficiency of our approach over competitive baseline approaches.

Graduation Semester

2018-08

Type of Resource

text

Permalink

http://hdl.handle.net/2142/101634

Copyright and License Information

Copyright 2018 Meng Qu

Owning Collections