Particle Swarm Optimization:
Particle Swarm Optimization (PSO) is a population-based optimization technique inspired by the
social behavior of bird flocking and fish schooling. It is used to find optimal or near-optimal solutions
in complex search spaces.
Basic Idea
In PSO, a group of particles (solutions) moves through the search space to find the best solution.
Each particle adjusts its position based on:
• Its own best experience (pbest)
• The best experience of the entire swarm (gbest)
Particles “learn” from each other and gradually move toward the optimal solution.
Key Concepts
1. Particle
A particle represents a candidate solution. Each particle has:
o Position (current solution)
o Velocity (direction of movement)
2. Swarm
A collection of particles exploring the search space.
3. Fitness Function
A function used to evaluate how good a solution is.
4. pbest (Personal Best)
The best solution a particle has achieved so far.
5. gbest (Global Best)
The best solution found by any particle in the swarm.
Working of PSO
1. Initialize particles with random positions and velocities.
2. Evaluate fitness of each particle.
3. Update pbest for each particle.
4. Update gbest from all particles.
5. Update velocity and position of each particle.
6. Repeat until stopping condition (max iterations or optimal solution).
Velocity and Position Update Formula
𝑣𝑖𝑡+1 = 𝑤𝑣𝑖𝑡 + 𝑐1 𝑟1 (𝑝𝑏𝑒𝑠𝑡𝑖 − 𝑥𝑖𝑡 ) + 𝑐2 𝑟2 (𝑔𝑏𝑒𝑠𝑡 − 𝑥𝑖𝑡 )
𝑥𝑖𝑡+1 = 𝑥𝑖𝑡 + 𝑣𝑖𝑡+1
Where:
• 𝑤= inertia weight (controls exploration)
• 𝑐1 , 𝑐2 = cognitive & social coefficients
• 𝑟1 , 𝑟2 = random values (0 to 1)
• 𝑥𝑖 = position of particle
• 𝑣𝑖 = velocity of particle
Advantages of PSO
• Simple to understand and implement
• Requires fewer parameters compared to other algorithms
• Fast convergence speed
• Effective for continuous optimization problems
• No need for gradient information
Disadvantages
• May get trapped in local optimum
• Performance depends on parameter tuning
• Not very effective for discrete problems
• Premature convergence can occur
Applications
• Function optimization problems
• Neural network training
• Image processing and pattern recognition
• Scheduling and resource allocation
• Engineering design optimization
Conclusion
Particle Swarm Optimization is an efficient and easy-to-implement optimization technique in
computational intelligence. By mimicking social behavior, particles collaborate to find the best
solution. Due to its simplicity and effectiveness, PSO is widely used in real-world optimization
problems.