To assess how much information about we expect to receive by observing
D, we may first identify the particular linear combination
for which we expect the adjustment by D to be most informative in the sense
that
maximises the resolution
over all elements
with non-zero prior variance. (Note from equation 10, that
maximising the resolution is equivalent to minimising the ratio of adjusted to
prior variance.) We may then proceed to identify directions for which we expect
progressively less information. This is equivalent to defining collections of canonical variables between
and
. We make the following definition.
DEFINITION The canonical direction for the adjustment of
B by D is the linear combination
which maximises
over
all elements
with non-zero prior variance which are
uncorrelated a priori with
. We scale each
to
have prior expectation zero and prior variance one. The values
are termed the canonical resolutions. The number of canonical directions that we may define is equal to the rank, r(B), of the variance matrix of the elements of B.
The quantities are mutually incorrelated. It is also the case that the adjusted expectations,
are also mutually uncorrelated, and each
is uncorrelated with each
The canonical resolutions may be calculated as the eigenvalues of the
resolution matrix, , defined as
We may calculate by finding the normed
eigenvectors,
, ordered by eigenvalues
, of
, so that
The collection forms a ``grid'' of directions
over
, summarising the effects of the adjustment. We expect to learn most
about those linear combinations of the elements of B which have large
correlations with those canonical directions with large resolutions. The exact
relation is as follows.
For any X in ,
where