next up previous
Next: COMBINING ERROR TERMS Up: OBJECTIVE FUNCTIONS FOR THE Previous: AN OBJECTIVE FUNCTION FOR

AN ERROR FUNCTION FOR THE INVERTIBILITY CRITERION

The following is a simple, well-known method for enforcing invertibility: With pattern $p$, a reconstructor module receives the concatenation of all $y^p_i$ as an input and is trained to emit as an output the reconstruction $z^p$ of the external input $x^p$. The basic structure is an auto encoder. The auto encoder's objective function, to be minimized, is defined as
\begin{displaymath}
I = \frac{1}{2}
\sum_p (z^p - x^p)^T(z^p - x^p) .
\end{displaymath} (3)



Juergen Schmidhuber 2003-02-13


Back to Independent Component Analysis page.