Skip to main content

What is LU decomposition, why do I care it? (1)

Gilbert Strang's Introduction to Linear Algebra 2.5

There is a method called LU decomposition. I, a Sunday researcher, always start a kind of stupid question.
- What is the LU decomposition?
- Why do I care about that?
LU decomposition is actually almost the Elimination method. The reason we do Elimination is we want to solve the system of linear equations.  I think the most important thing is understanding the problem. If we could not get the answer, but only understand the problem, it is a bit sad for me. I hope I can have a solution also. Elimination is one of the methods to solve the system. This method adds or subtracts one equation from other equation to remove some of the variables. In a junior high school in Japan, I learned this as elimination of simultaneous equation (連立一 次方程式の消去法). Let's see an elimination example using the following matrix A.

Remove a_{21}, a_{31} of A by applying Elimination matrices E_{21},E_{31}. For example, E_{21} subtracts row 1 from row 2 of A to removes a_{21}, therefore, the component of E_{21} is -1, the rest is identity matrix. E_{32} is not known at this point.


E_{21} E_{31} A is the following, this removes a_{21} and a_{31}. You see now they are zeros.
Now we know a_{32} of A is _2_. To make this triangular matrix, E_{32} is the following. The result of Elimination is:

 This is U of LU decomposition. L is the following.

When you see the component of the equation L = (E_{32} E_{31} E_{21})^{-1}, each component shows up in the L with the sign inverted. I put the corresponding component the same color in Equation (5).

I was surprised of this correspondences. Because I know the exact result of multiplication of the matrices without multiplying them. How convenient this is. Today, I stop here and I would like to think about the reason of this.

Comments

Popular posts from this blog

Why parallelogram area is |ad-bc|?

Here is my question. The area of parallelogram is the difference of these two rectangles (red rectangle - blue rectangle). This is not intuitive for me. If you also think it is not so intuitive, you might interested in my slides. I try to explain this for hight school students. Slides:  A bit intuitive (for me) explanation of area of parallelogram  (to my site, external link) . 

Geometric Multiplicity: eignvectors (2)

If eigenvectors of a matrix A are independent, it is a happy property. Because the matrix A can be diagonalized with a matrix S that column vectors are eigenvectors of A . For example, Why this is a happy property of A? Because I can find A's power easily. A^{10} is not a big deal. Because Λ is a diagonal matrix and power of a diagonal matrix is quite simple. A^{10} = SΛ^{10} S^{-1} Then, why if I want to compute power of A ? That is the same reason to find eigenvectors. Eigenvectors are a basis of a matrix. A matrix can be represented by a single scalar. I repeat this again. This is the happy point, a matrix becomes a scalar. What can be simpler than a scalar value. But, this is only possible when the matrix S's columns are independent. Because S^{-1} must be exist. Now I come back to my first question. Is the λ's multiplicity related with the number of eigenvectors? This time I found this has the name. Geometric multiplicity (GM): the number of in...

Tezuka Osamu's Black Jack, "Shrinking"

I like several novel authors. My first favorite author is probably Teduka, Osamu. I still love him. The list grows by adding Hoshi, Shinichi, Agatha Christie, Hermann Hesse, and so forth. My first favorite article of Tezuka was Atom as most of the (boy's) Tezuka fans did. But my favorite is Black Jack. I try to summarize one story, it is still quite vivid in my memory. I first read this story when I was 13 - 15 years old. I re-read it at least several times since Black Jack is composed of many short episodes. The title should be "ちぢむ (SHRINKING)" or it might be "縮む(Shrinking)". (It is not so convenient to translate this to English, since English does not have a system to say the exact same word in several ways. So I just simulate it with capital letters.) Black Jack is a genius surgeon, but he does not have the license. In short, his medical activity is illegal. His skill is top level in the world, but, the fee is also out-of-law expensive. In the story ...