Scholars Central

Conference abstractPublished 26 Sep 2018

Adaptive sequential learning

Authors: Venugopal V Veeravalli

University of Illinois at Urbana-Champaign, USA

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

A framework is introduced for learning a sequence of slowly changing tasks, where the parameters of the learning algorithm are obtained by minimizing a loss function to the desired accuracy using optimization algorithms such as Stochastic Gradient Descent (SGD). The tasks are assumed to change slowly in the sense that the optimum values of the learning algorithm parameters change at a bounded rate. An adaptive sequential learning algorithm is developed to efficiently solve such a slowly varying sequence of tasks. The key idea behind the approach, which distinguishes it from existing methods for online optimization, involves using a probably efficient estimator for the change in minimizer in conjunction with the optimization at each stage. This estimator allows for an accurate tracking of the minimizer over time, thereby adapting the algorithm to allow it to use the fewest number of samples at each stage. Experiments with synthetic and real data sets are presented that validate the theoretical results. Extensions to incorporate possible abrupt changes and active learning are also discussed..

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Journal of Computer Science & Systems Biology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Computer Science & Systems Biology
  • SubjectComputer Science & IT
  • BylineArticles whose byline prints “Venugopal V Veeravalli”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels