Labs for Course 'Numberical Calcualtion & Optimization Theory'

Source code for labs.

Numberical Calcualtion

• Lab1 (Solution of Equations)
  • Solution of Linear Equations System.
    • Principle Component Method
    • Jacobi Iteration ALgorithm
    • Gauss-Seidel Iteration Algorithm
  • Solution of Nolinear Equations. (!:TODO: how to define the loss of secant method?)
    • Bisection Method
    • Newton's Method
    • Secant Method
• Lab2 (Interpolation)
  • 1D Interpolation Methods.
    • Lagrange interpolation
    • Newtonian interpolation
    • cubic spline interpolation
    • Aitken interpolation
    • Hermit interpolation
  • Higher Dimensional Interpolation Methods. (TODO)
    • 2D
    • 3D
• Lab3 (Optimisation)
  • approximation of functions (TODO)
• Lab4 (Difference Equations)
  • Solution of Differential Equations (TODO)
  • Solution of Non-Linear Differential Equations (TODO)

Optimisation Algorithms

• Lab1 (Gradient Descent)
  • Stochastic Gradient Descent (TODO)
  • Mini-Batch Gradient Descent (TODO)
  • Batch Gradient Descent (TODO)
  • Adaptive Moment Estimation (TODO)
  • Momentum (TODO)
  • Nesterov Accelerated Gradient Descent (TODO)
  • RMSprop (TODO)
  • Adam (TODO)
  • NAG (TODO)
  • Adagrad (TODO)
  • Adadelta (TODO)
• Lab2 (Heuristic Methods)
  • Genetic Algorithm
  • Particle Swarm Optimization (TODO)
  • Multi-Layer Perceptron (TODO)
  • Ant Colony optimization (TODO)
  • Simulated Annealing (TODO)