AI505 Paper list for share

1. ADAM: A METHOD FOR STOCHASTIC OPTIMIZATION https://arxiv.org/pdf/1412.6980.pdf 2. SVRG https://papers.nips.cc/paper/4937-accelerating-stochastic-gradient-descent-using-predictive-variance-reduction.pdf 3. SGD: General Analysis and Improved Rates https://arxiv.org/pdf/1901.09401.pdf 4. A CLOSER LOOK AT DEEP LEARNING HEURISTICS: LEARNING RATE RESTARTS, WARMUP AND DISTILLATION https://openreview.net/pdf?id=r14EOsCqKX 5. QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding https://arxiv.org/abs/1610.02132 6. SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly …

Read moreAI505 Paper list for share

Note2. Convex Optimization Problem 02.

Note2. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on “Optimization for AI (AI505)” lecture notes at KAIST. For the supplements, lecture notes from Martin Jaggi [link] and “Convex Optimization” book of Sebastien Bubeck [link] were used. If you will have found any license issue, …

Read moreNote2. Convex Optimization Problem 02.

Note1. Convex Optimization Problem 01.

Note1. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on “Optimization for AI (AI505)” lecture notes at KAIST. For the supplements, lecture notes from Martin Jaggi [link] and “Convex Optimization” book of Sebastien Bubeck [link] were used. If you will have found any license issue, …

Read moreNote1. Convex Optimization Problem 01.

ICCV2019 in Seoul Review

From 27 OCT to 2 NOV, ICCV 2019 was held in Coex Seoul. [official webpage link]: http://iccv2019.thecvf.com/ I summarized attended programs below. SUN 27 OCT Tutorial. “Interpretable Machine Learning for Computer Vision“ [link] : https://interpretablevision.github.io/ 1. Andrea Vedaldi: Understanding Models via Visualization and Attribution – Generating conic examples > Inversion vs activation maximization > The importance …

Read moreICCV2019 in Seoul Review

MIT 18.06 Linear Algebra – Basics (Lec01~Lec03)

I’ve written this post based on ‘Linear Algebra’ lectures (MIT 18.06 from lecture-01 to lecture-03) by Gilbert Strang. This post is intended for person who needs to learn basic knowledge about linear algebra. (YouTube link for Strang’s Linear Algebra : Here ) At this post, I used One-Note (Microsoft) program replacing original hand-written notes. So, …

Read moreMIT 18.06 Linear Algebra – Basics (Lec01~Lec03)

ISLR chapter 03. Linear Regression_3.1 Simple Linear Regression

From below I’ve quoted some paragraphs from page 59~page 70  directly in the ISLR book.   Recall the Advertising data from Chapter 2. The figure below displays sales for a particular product as a function of advertising budgets for TV, radio, and newspaper media. Suppose that in our role as statistical consultants we are asked …

Read moreISLR chapter 03. Linear Regression_3.1 Simple Linear Regression

ISLR chapter 02. Statistical Learning

2.1 What Is Statistical Learning? X : input variables; predictors; independent variables Y : output variables; response; dependent variable Suppose that we observe a quantitative response Y and p different predictors, . We assume that there is some relationship between Y and 《Very general form》   2.1.1 Why Estimate f ? ① Prediction We can …

Read moreISLR chapter 02. Statistical Learning

ISLR chapter 01. Introduction

A Brief History of Statistical Learning Though the term statistical learning is fairly new, many of the concepts that underlie the field were developed long ago. At the beginning of the nineteenth century, Legendre and Gauss published papers on the method of least squares, which implemented the first successfully applied to problems in astronomy. Linear …

Read moreISLR chapter 01. Introduction

Probability and likelihood learned from On-Base Percentage

The previous post was dealt with likelihood . Let’s take a look at some interesting examples introduced in “Major League Baseball statistics”. (Book in Korean) The R markdown can be found in Github  and this post is quoted partially from chapter 4 in the book mentioned above.   1. The probability that goes on the base twice …

Read moreProbability and likelihood learned from On-Base Percentage

Likelihood

likelihood ? It’s very confusing concept to me, very difficult to understand at a glance. I’ve looked for the definition from Wikipedia and sought some blogs which explained about it. First of all I’ve referred sw4r  ‘s blog which contained huge amount of numerical statistics. And I found the definition of ‘Likelihood’ in Wikipedia which was really …

Read moreLikelihood