8.6. APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS

Lecture



Incompatibility of the system of equations   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS means that for none of the possible assessments   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS the system will not go over into identity with the substitution   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS instead   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS . In such cases, the system of equations can be converted to

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.1)

Where   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS - error vector depending on   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS . We now find the value of the estimate.   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS at which the value of the error is minimal, expressed by two equivalent ratios:

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.2а)

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.2b)

Let the symbol   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS denotes a pseudoinverse matrix, which is used to estimate

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.3)

Adding and removing work   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS inside both brackets of the relation (8.6.2а), we get

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.4)

After multiplying we have

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.5)

Two cross terms will be zero if   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS and   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS . However, under these conditions, the matrix   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS is the least squares inversion matrix, i.e.   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS . Then the error will be equal to the sum of two positive terms:

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.6)

The second term of equality (8.6.6) turns into zero, since   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS . Therefore, the error is reduced to

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.7а)

or, which is the same,

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.7b)

As expected, the error is zero if   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS .

The solution obtained by least-squares pseudo-inversion may not be the only one. If at pseudo-reversal to enter additional conditions   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS and   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS for which the matrix   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS is a generalized inverse (i.e.   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS ), it can be shown that the estimate obtained using this matrix (   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS ), is a solution with a minimum rate in the sense that

  8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS (8.6.8)

Where   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS - arbitrary estimate, found by the method of least squares. If the generalized inverse matrix   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS has rank   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS and satisfies the definition (8.3.5), then the product   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS not necessarily equal to the identity matrix, but the error can be found from relations (8.6.7). If the matrix   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS has rank   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS , i.e. corresponds to the definition (8.3.6), then   8.6.  APPROXIMATE SOLUTIONS OF INCOMPATIBLE SYSTEMS OF LINEAR EQUATIONS the error is zero.

The following chapters will show how these theoretical assumptions are applied to correct, analyze, and encode images.


Comments


To leave a comment
If you have any suggestion, idea, thanks or comment, feel free to write. We really value feedback and are glad to hear your opinion.
To reply

Digital image processing

Terms: Digital image processing