An empirical study of the properties of meta-learning - presentation

Brando Miranda

Permalink

https://hdl.handle.net/2142/109112 Copy

Description

Title

An empirical study of the properties of meta-learning - presentation

Author(s)

Brando Miranda

Issue Date

2020-12-16

Keyword(s)

• meta-learning
• machine learning
• AI
• AGI
• artificial intelligence
• artificial general intelligence
• automl

Abstract

It has been recently observed that a good embedding is all we needed to solve many few-shot learning benchmarks. In addition, other work has strongly suggested that MAML mostly works via this same method: by learning a good embedding. Therefore, this highlights our lack of understanding of what meta-learning algorithms are doing and when they work. In this work we provide preliminary results that shed some light towards understanding meta-learning algorithms better. In particular we identify 3 interesting properties: 1) It's possible to define a synthetic task that results in higher degree of meta-adaptation, thus suggesting that current few-shot learning benchmarks might not have the properties needed for the success of meta-learning algorithms 2) meta-overfitting occurs when the number of classes (or concepts) are finite and this issue disappears once the task has an unbounded number of concepts 3) more adaptation for MAML does not necessarily result in representations that have adapted more or even perform better. Finally, we suggest that to understand meta-learning algorithms better it is imperative that we go beyond tracking only absolute performance and in addition formally quantify the degree of meta-learning and track both metrics together. Reporting results in future work this way should help us identify the sources of meta-overfitting more accurately and hopefully design more flexible meta-learning algorithms.

Type of Resource

moving image

Language

en

Permalink

http://hdl.handle.net/2142/109112

Owning Collections