A scenario-cluster-based and enhanced progressive hedging algorithm for the two-stage stochastic quadratic knapsack problem

Abstract

This paper introduces the two-stage stochastic quadratic knapsack problem (TSSQKP) with uncertainty in profits and weights. To overcome the computational difficulties arising from the combined stochastic, binary, and quadratic structure, we propose a solution framework that integrates an adaptation of the progressive hedging algorithm with clustering-based scenario reduction. The enhanced progressive hedging algorithm (EPHA) incorporates a rounding procedure and a dynamic penalty update strategy driven by the detection of oscillation and stagnation patterns. In parallel, we propose a clustering framework based on opportunity-cost distances between scenarios, from which we derive the medoid lower bound (MLB), the cluster lower bound (CLB) and the cluster upper bound (CUB). To further improve computational efficiency, EPHA is also used to solve the cluster subproblems heuristically; in this case, the resulting upper bound is referred to as the estimated cluster upper bound (ECUB), and the corresponding gaps are interpreted as estimated optimality gaps. Computational experiments on 800 generated TSSQKP instances show that the proposed framework yields smaller gaps than CPLEX under comparable computational conditions. In the EPHA-based clustering framework, the average estimated gaps associated with the CLB, EPHA and MLB 1.65%, 1.88% and 2.41% respectively, compared with an average optimality gap of 35.86% for CPLEX. MLB is fastest to compute, with an average execution time of 420.88s, while EPHA provides a favourable compromise between solution quality and computational effort, reducing the average computational time associated with the cluster bounds by approximately 52.7%, while increasing the average estimated gap by only 0.23 percentage points.