Undergraduate and Graduate Schools

Home > Undergraduate and Graduate Schools > Faculty Members List > Department of Computer Science and Engineering > Watanabe, Kazuho

Watanabe, Kazuho

Affiliation Department of Computer Science and Engineering
Title Associate Professor
Fields of Research Statistical Learning Theory / Machine Learning
Degree Ph. D. (Tokyo Institute of Technology)
Academic Societies IEICE / JNNS / IEEE
E-mail wkazuho@cs
Please append "" to the end of the address above.
Laboratory website URL
Researcher information URL(researchmap) Researcher information


Machine learning techniques are widely used for pattern recognition, robot control, and so on. We study fundamental theories of machine learning based on statistical and information theoretic methods, and apply them to data analysis problems.

Theme1:Analysis and Development of Statitstical Learning Methods


Machine learning techniques are widely used for various applications such as pattern recognition and robot control. We aim to analyze and develop learning and inference methods, and apply them to problems such as data analysis and visualization.

Selected publications and works

Yoshida, T. and Watanabe, K. (2018), Empirical Bayes estimation for L_1 regularization: a detailed analysis in the one-parameter lasso model, IEICE Transactions on Fundamentals, E101-A(12), 2184-2191.
Kobayashi, M. and Watanabe, K. (2017), A rate-distortion theoretic view of Dirichlet process means clustering, IEICE Transactions on Fundamentals, J100-A(12), 475-486 (in Japanese).
Watanabe, K. and Roos, T. (2015), Achievability of asymptotic minimax regret by horizon-dependent and horizon-independent strategies, Journal of Machine Learning Research, 16, 2357-2375.
Watanabe, K. and Ikeda, S. (2015), Entropic risk minimization for nonparametric estimation of mixing distributions, Machine Learning, 99(1), 119-136.


Bayesian inference, learning algorithm, data visualization

Theme2:Rate-Distortion Theory

Rate-distortion function

Rate-distortion functions show the minimum information content required for reconstructing compressed data under allowed distortion levels.
We aim at evaluating rate-distortion functions of distortion measures used in practical learning algorithms and information sources modeling real data generation processes.

Selected publications and works

Konabe, R. and Watanabe, K. (2018), Sparse regression code with sparse dictionary for absolute error criterion, Proc. of ISIT2018, 1515-1519.
Watanabe, K. (2017), Projection to mixture families and rate-distortion bounds with power distortion measures, Entropy, Special Issue: Information Geometry II, 19(6), 262.
Watanabe, K. and Ikeda, S. (2016), Rate-distortion functions for gamma-type sources under absolute-log distortion measure, IEEE Transactions on Information Theory, 62(10), pp.5496-5502.
Watanabe, K. (2015), Vector quantization based on epsilon-insensitive mixture models, Neurocomputing, 165, 32-37.


rate-distortion function, lossy data compression

Title of class

Information Theory and Coding: B12630030(Dept. EEIE), B13630010(Dept. CSE)

Others (Awards, Committees, Board members)

Encouragement Award (IEICE SITA Subsociety), 2013.
Best Paper Method Award (German Classification Society), 2010.
Best Paper Award (Japanese Neural Network Society), 2008.

to Page top