Richard Liaw

Richard Liaw
Are you Richard Liaw?

Claim your profile, edit publications, add additional information:

Contact Details

Name
Richard Liaw
Affiliation
Location

Pubs By Year

Pub Categories

 
Computer Science - Robotics (1)
 
Computer Science - Learning (1)
 
Computer Science - Artificial Intelligence (1)
 
Computer Science - Distributed; Parallel; and Cluster Computing (1)

Publications Authored By Richard Liaw

Machine learning applications are increasingly deployed not only to serve predictions using static models, but also as tightly-integrated components of feedback loops involving dynamic, real-time decision making. These applications pose a new set of requirements, none of which are difficult to achieve in isolation, but the combination of which creates a challenge for existing distributed execution frameworks: computation with millisecond latency at high throughput, adaptive construction of arbitrary task graphs, and execution of heterogeneous kernels over diverse sets of resources. We assert that a new distributed execution framework is needed for such ML applications and propose a candidate approach with a proof-of-concept architecture that achieves a 63x performance improvement over a state-of-the-art execution framework for a representative application. Read More

Reinforcement Learning (RL) struggles in problems with delayed rewards, and one approach is to segment the task into sub-tasks with incremental rewards. We propose a framework called Hierarchical Inverse Reinforcement Learning (HIRL), which is a model for learning sub-task structure from demonstrations. HIRL decomposes the task into sub-tasks based on transitions that are consistent across demonstrations. Read More