Please log in to watch this conference skillscast.
Reinforcement learning (RL) is a powerful machine learning paradigm that has been successfully applied to a wide class of problems, from steering helicopters to predicting stock prices. During this talk you will find out what RL is all about and how to implement it in Scala. Chris will introduce RL, providing use cases and intuition about what kind of problems it can solve. He'll also share some of its core concepts, including Markov Decision Processes, policies and action values, prediction and control, exploitation vs exploration and bootstrapping.
Next you'll implement some of these concepts in Scala, starting from scratch and working step by step towards an implementation of 'Q-learning' – a popular RL technique for learning policies. You'll structure your code using type classes to separate the generic Q-learning framework from the specifics of any particular problem we want to model.
You will also learn how to train an agent using your Q-learning implementation, and finally Chris will demonstrate the result of the training: the computer successfully playing a simple game.
YOU MAY ALSO LIKE:
- Writing an SBT Plugin (SkillsCast recorded in February 2019)
- Lightbend Scala Language - Professional (in London on 9th - 10th September 2019)
- Lightbend Scala Language - Expert (in London on 11th - 13th September 2019)
- Scala eXchange London 2019 (in London on 12th - 13th December 2019)
- London TensorFlow.js (in London on 20th June 2019)
- Keynote by Dick Wall on Why API Design Matters, and Why Yours Sucks! (and mine sucks too!) (in London on 24th June 2019)
- Knowledge Transfer in Reinforcement Learning (SkillsCast recorded in May 2019)
- Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning (SkillsCast recorded in May 2019)
Reinforcement Learning in Scala
Chris is a principal software developer at OVO Energy, where he looks after authentication and personal data as a member of the Identity team. He is the author of the ScalaCache library. He has been using Scala for work and play since 2010.