Guozhen AIGlobal AI field notes and model intelligence

English translation

13. Gaussian Elimination for Systems of Linear Equations

Published:

Category: Linear Algebra for AI Beginners

Read time: 4 min

Reads: 0

Lesson #13Views are counted together with the original Chinese articleImages are preserved from the source page

Conceptual Diagram of Gaussian Elimination

Gaussian elimination fundamentally simplifies a system of linear equations using equivalent transformations—operations that preserve the solution set while progressively revealing its structure.

Verification Diagram for Gaussian Elimination

At each step, I verify whether the row operations performed are indeed equivalent transformations—and then interpret the resulting row-echelon form to determine whether the system has no solution, a unique solution, or infinitely many solutions.

In the previous article, we introduced the definition and fundamental properties of linear equations. Today, we focus on a cornerstone technique for solving systems of linear equations: Gaussian elimination. This method holds a central place in linear algebra theory—and is equally indispensable in real-world applications across science and engineering.

What Is Gaussian Elimination?

Gaussian elimination is a systematic procedure that uses elementary row operations to transform a system of linear equations into a simpler, more structured form—typically an upper-triangular or row-echelon matrix—making it straightforward to solve for the unknowns via back substitution.

Steps of Gaussian Elimination

  1. Construct the Augmented Matrix: Convert the system of linear equations into its augmented matrix representation.

    For the system:

    a1x+b1y+c1z=d1a2x+b2y+c2z=d2a3x+b3y+c3z=d3\begin{align*} a_1x + b_1y + c_1z &= d_1 \\ a_2x + b_2y + c_2z &= d_2 \\ a_3x + b_3y + c_3z &= d_3 \end{align*}

    the corresponding augmented matrix is:

    [a1b1c1d1a2b2c2d2a3b3c3d3]\left[\begin{array}{ccc|c} a_1 & b_1 & c_1 & d_1 \\ a_2 & b_2 & c_2 & d_2 \\ a_3 & b_3 & c_3 & d_3 \end{array}\right]
  2. Perform Row Operations: Apply elementary row operations to convert the matrix into upper-triangular (or row-echelon) form. These operations include:

    • Swapping two rows,
    • Multiplying a row by a nonzero scalar,
    • Adding a scalar multiple of one row to another row.
  3. Back Substitution: Once the matrix is in upper-triangular form, solve for the variables starting from the bottom row and working upward.

Worked Example

Consider the following linear system:

2x+3y+z=1(1)4x+y2z=2(2)2x+5y+3z=7(3)\begin{align*} 2x + 3y + z &= 1 \quad \text{(1)} \\ 4x + y - 2z &= -2 \quad \text{(2)} \\ -2x + 5y + 3z &= 7 \quad \text{(3)} \end{align*}

Step 1: Construct the Augmented Matrix

The augmented matrix is:

[231141222537]\left[\begin{array}{ccc|c} 2 & 3 & 1 & 1 \\ 4 & 1 & -2 & -2 \\ -2 & 5 & 3 & 7 \end{array}\right]

Gaussian Elimination Decision Card

When learning Gaussian elimination, first identify the augmented matrix, pivot positions, row operations, row-echelon form, back substitution, and how to diagnose inconsistent or underdetermined systems.

Step 2: Perform Row Operations

  • Replace Row 2 with R22R1R_2 - 2R_1:

R2=R22R1R_2 = R_2 - 2R_1 [231105442537]\left[\begin{array}{ccc|c} 2 & 3 & 1 & 1 \\ 0 & -5 & -4 & -4 \\ -2 & 5 & 3 & 7 \end{array}\right]
  • Replace Row 3 with R3+R1R_3 + R_1:

    R3=R3+R1R_3 = R_3 + R_1 [231105440848]\left[\begin{array}{ccc|c} 2 & 3 & 1 & 1 \\ 0 & -5 & -4 & -4 \\ 0 & 8 & 4 & 8 \end{array}\right]
  • Scale Row 2 by 15-\frac{1}{5}:

    [23110145450848]\left[\begin{array}{ccc|c} 2 & 3 & 1 & 1 \\ 0 & 1 & \frac{4}{5} & \frac{4}{5} \\ 0 & 8 & 4 & 8 \end{array}\right]
  • Replace Row 3 with R38R2R_3 - 8R_2:

    R3=R38R2R_3 = R_3 - 8R_2 [231101454500450]\left[\begin{array}{ccc|c} 2 & 3 & 1 & 1 \\ 0 & 1 & \frac{4}{5} & \frac{4}{5} \\ 0 & 0 & -\frac{4}{5} & 0 \end{array}\right]
  • Step 3: Back Substitution

    Start from the last row:

    45z=0z=0-\frac{4}{5}z = 0 \quad \Rightarrow \quad z = 0

    Substitute into Row 2:

    y+45z=45y+0=45y=45y + \frac{4}{5}z = \frac{4}{5} \quad \Rightarrow \quad y + 0 = \frac{4}{5} \quad \Rightarrow \quad y = \frac{4}{5}

    Substitute into Row 1:

    2x+3(45)+0=12x+125=12x=1125=75x=7102x + 3\left(\frac{4}{5}\right) + 0 = 1 \quad \Rightarrow \quad 2x + \frac{12}{5} = 1 \quad \Rightarrow \quad 2x = 1 - \frac{12}{5} = -\frac{7}{5} \quad \Rightarrow \quad x = -\frac{7}{10}

    Thus, the unique solution is:

    x=710,y=45,z=0.\begin{align*} x &= -\frac{7}{10}, \\ y &= \frac{4}{5}, \\ z &= 0. \end{align*}

    Linear Algebra Reading Roadmap Card

    Before reading “Systems of Linear Equations: Gaussian Elimination”, use the accompanying diagram to confirm the conceptual flow; after reading, revisit which steps you can execute directly—and which require supplementary study.

    Application Recap Card: Gaussian Elimination

    When reviewing “Systems of Linear Equations: Gaussian Elimination”, place key concepts, procedural steps, and observable outcomes side-by-side on a single page for efficient consolidation.

    Application Check Card: Gaussian Elimination

    When practicing “Systems of Linear Equations: Gaussian Elimination”, record input conditions, transformation actions, and resulting outputs together—so they’re readily verifiable next time.

    Summary

    Gaussian elimination is a robust, systematic method for solving linear systems. By constructing an augmented matrix and applying carefully chosen elementary row operations, we reduce the system to a tractable form—enabling clear analysis and solution. In practice, this technique underpins countless applications in physics, computer science, economics, and engineering.

    In the next article, we’ll explore the distinction between homogeneous and nonhomogeneous linear systems—and their respective roles and interpretations. Stay tuned!

    Continue

    Keep reading from here

    Browse English site

    Reader Messages

    Reader messages

    Questions, corrections, extra sources, or hands-on results can be left here. No login is required.

    Max 800 characters

    To reduce spam, each message is checked for length, link count, and posting frequency.

    0/800

    Messages

    0 messages
    Loading messages...