Skip to main content

Eigenvalue and transfer function (5)

Eigenvalue and Eigenvector

Vector case

Next, let's think about vector. I assume the readers know about matrix multiplication a bit. When a matrix applies to a vector, then this generates a new vector. For example, a matrix can rotate a vector, or enlarge/shrink a vector. We say we can apply a matrix A to a vector x. The matrix A could be a rotation operation, or any. The result of application creates a new vector b.

 Ax=b

If you see this, it looks like scalar's multiplication. But, usually A is quite complex and hard to understand what it is. But if there is a scalar λ and a vector x', such that

 A x' = λ x'.

This means:
We can replace a complex matrix A with a scalar value λ. 
I think this sentence has the whole idea of this topic. Usually it is not possible to find such λ for any vector. But, we have a chance to find a specific x' and its relating a scalar value λ.

When I saw this, I said, ``Wow.'' This is a powerful idea. If I see a 100x100 matrix, I have no idea what this matrix does unless it has a very specific form (e.g., I can tell what an identity matrix does). But, if we could find this pair, a matrix A multiplies the vector x' λ times.

Here, A does something on a vector. For instance, it could be a rotation, a transformation, a magnification. The substance of the matrix is in the λ and x'. These λ and x' are called the substance or property of the matrix: eigenvalue λ and eigenvector x'.

Now you see why mathematicians think about eigenvalues and eigenvectors. A matrix A is usually so complex and nobody can understand it. But, if we can find a simpler form, scalar multiplication, we can see ``an aspect'' of A. This is called eigenanalysis.

By the way, one n by n matrix A (n>1) has usually many eigenvalues and eigenvectors. If we could always have one eigenvalue and one eigenvector for a huge matrix, it sounds simple, but, the world is not so easy. Please note that there are many eigenvalues for one matrix, therefore, I use ``an aspect'' of a matrix.

Comments

Popular posts from this blog

Why A^{T}A is invertible? (2) Linear Algebra

Why A^{T}A has the inverse Let me explain why A^{T}A has the inverse, if the columns of A are independent. First, if a matrix is n by n, and all the columns are independent, then this is a square full rank matrix. Therefore, there is the inverse. So, the problem is when A is a m by n, rectangle matrix.  Strang's explanation is based on null space. Null space and column space are the fundamental of the linear algebra. This explanation is simple and clear. However, when I was a University student, I did not recall the explanation of the null space in my linear algebra class. Maybe I was careless. I regret that... Explanation based on null space This explanation is based on Strang's book. Column space and null space are the main characters. Let's start with this explanation. Assume  x  where x is in the null space of A .  The matrices ( A^{T} A ) and A share the null space as the following: This means, if x is in the null space of A , x is also in the n...

Gauss's quote for positive, negative, and imaginary number

Recently I watched the following great videos about imaginary numbers by Welch Labs. https://youtu.be/T647CGsuOVU?list=PLiaHhY2iBX9g6KIvZ_703G3KJXapKkNaF I like this article about naming of math by Kalid Azad. https://betterexplained.com/articles/learning-tip-idea-name/ Both articles mentioned about Gauss, who suggested to use other names of positive, negative, and imaginary numbers. Gauss wrote these names are wrong and that is one of the reason people didn't get why negative times negative is positive, or, pure positive imaginary times pure positive imaginary is negative real number. I made a few videos about explaining why -1 * -1 = +1, too. Explanation: why -1 * -1 = +1 by pattern https://youtu.be/uD7JRdAzKP8 Explanation: why -1 * -1 = +1 by climbing a mountain https://youtu.be/uD7JRdAzKP8 But actually Gauss's insight is much powerful. The original is in the Gauß, Werke, Bd. 2, S. 178 . Hätte man +1, -1, √-1) nicht positiv, negative, imaginäre (oder gar um...

Why parallelogram area is |ad-bc|?

Here is my question. The area of parallelogram is the difference of these two rectangles (red rectangle - blue rectangle). This is not intuitive for me. If you also think it is not so intuitive, you might interested in my slides. I try to explain this for hight school students. Slides:  A bit intuitive (for me) explanation of area of parallelogram  (to my site, external link) .