The newest version of the course on wiki
(in Russian only).
basic notions of learning by examples,
examples of applied problems,
empirical risk minimization,
maximization of likelihood,
Bayesian theory of classification
the optimality of Bayesian classifier,
non-parametric density estimations,
linear discriminant of Fisher,
the mixture model of density,
the network of radial basis functions.
nearest neighbor classifier and its generalization,
Parzen window again,
potential functions method,
object weights optimization,
statistical clustering (EM and k-means),
agglomerative algorithm, dendrogram.
robust non-parametric regression (LOWESS),
singular value decomposition,
regularization and ridge regression,
generalized additive models,
orthogonalization and stepwise regression,
lasso and least angle regression.
Generalization and model assessment
structural risk minimization,
Akaike information criterion,
Bayes information criterion.
internal and external criteria,
complexity optimization concepts,
add-del and stepwise methods,
depth-first and breadth-first search strategies,
iterative procedure of GMDH (group method of data handling),
genetic features selection,
adaptive stochastic search.
Rozenblatt's, Hebb's, delta (ADALINE) rules,
optimal brain damage,
many heuristics against overfitting, paralysis and slow convergence.
WTA, WTM and CWTA strategies,
Kohonen maps and the art of their interpreting.
Support Vector Machine
optimal separating hyperplane,
hard- and soft-margin hyperplane,
ten rules to build kernels,
links with two-layer networks, RBF and EM-algorithm.
simple, majority, seniority and weighted voting,
heuristic algorithms for learning simple and seniority voting compositions,
boosting, bagging, random subspace method,
mixture of experts,
hierarchical mixture of experts.
Logic (discrete) classification
basic notions of predicate, rule and regularity,
forms of regularities (conjunctions, balls? and hyperplaines in low-dimension subspaces),
stochastic local search for learning conjunctions,
decision tree, ID3, pre-pruning and post-pruning,
look-a-head and anytime algorithms,
depth-first and breadth-first search strategies (KORA and TEMP algorithms),
weighted voting of rules via boosting,
Zhuravlev's algorithm of estimations calculation,
association rules and aPriory algorithm.
The course programme (in Russian)
Practical work (in Russian)
Scientific research directions
Full text here:
Bounding the probability of overfitting,
enhancement the generalization ability of learning algorithms,
computational learning theory,
exact statistical tests,
Multiple classifier systems,
mixture of experts.
Collaborative filtering and clients environment analysis,
web usage mining,
client relationship management.