arXiv ScienceSearch

arXiv subjects

Stefano Benati

Publications and source records attributed to Stefano Benati.

7 recordsLinked to original sources

Scaled Null-Adjusted Persistence: A Multiscale Bridge between Modularity and Persistence

Community detection methods must balance two competing objectives: identifying small, cohesive groups while avoiding excessive fragmentation. Modularity, the most widely adopted optimization criterion, typically merges small communities in large networks due to its resolution limit. In contrast, a persistence-based criterion promotes more granular partitions. We introduce Scaled Null-Adjusted Persistence (Scaled-NAP), a parametric family of quality functions that incorporates both these criteria. The definition exploits the exact identity between a cluster's modularity contribution and its Null-Adjusted Persistence (NAP) multiplied by its relative volume. Raising this volume factor to a parameter $\alpha\in[0,1]$ yields NAP at $\alpha=0$ and modularity at $\alpha=1$, while intermediate values control the scale of the detected partition. We derive conditions under which merging two communities improves the objective function and characterize the emergence of scale dependence, including resolution-limit behaviour on Caveman graphs. We develop the Milano algorithm, a multilevel Louvain-style heuristic for optimizing Scaled-NAP on large networks. Experiments on weighted and unweighted Lancichinetti-Fortunato-Radicchi benchmarks show that Scaled-NAP achieves the highest or tied-highest recovery wherever the ground truth structure is detectable, with its advantage increasing under community-size heterogeneity. Tests on three real networks with up to 1.1 million nodes confirm its capability to identify fine-grained ground-truth communities. The Milano algorithm also turned out to be the fastest method evaluated on large networks. These results show that Scaled-NAP provides an effective and scalable bridge between modularity-based and persistence-based community detection methodologies.

cs.SI

Null-adjusted persistence function for high-resolution community detection

Modularity and persistence probability are two widely used quality functions for detecting communities in complex networks. In this paper, we introduce a new objective function called null-adjusted persistence, which incorporates features from both modularity and persistence probability, as it implies a comparison of persistence probability with the same null model of modularity. We prove key analytic properties of this new function. We show that the null-adjusted persistence overcomes the limitations of modularity, such as scaling behavior and resolution limits, and the limitation of the persistence probability, which is an increasing function with respect to the cluster size. We propose to find the partition that maximizes the null-adjusted persistence with a variation of the Louvain method and we tested its effectiveness on benchmark and real networks. We found out that maximizing null-adjusted persistence outperforms modularity maximization, as it detects higher resolution partitions in dense and large networks.

physics.soc-ph

A Mathematical Programming approach to Overlapping community detection by cluster's Shapley value

We propose a new model to detect the overlapping communities of a network that is based on cooperative games and mathematical programming. More specifically, communities are defined as stable coalitions of a weighted graph community game and they are revealed as the optimal solution of a mixed-integer linear programming problem. Exact optimal solutions are obtained for small and medium sized instances and and it is shown that they provide useful information about the network structure, improving on previous contributions. Next, a heuristic algorithm is developed to solve the largest instances and used to compare two variations of the objective function.

math.OC

A Network Model for Multiple Selection Questions in Opinion Surveys

Opinion surveys can contain closed questions to which respondents can give multiple answers. We propose to model these data as networks in which vertices are eligible items and arcs are respondents. This representation opens up the possibility of using complex networks methodologies to retrieve information and most prominently, the possibility of using clustering/community detection techniques to reduce data complexity. We will take advantage of the implicit null hypothesis of the modularity function, namely, that items are chosen without any preferential pairing, to show how the hypothesis can be tested through the usual calculation of p-values. We illustrate the methodology applying it to Eurobarometer data. There, a question about national concerns can receive up to two selections. We will show that community clustering groups together concerns that can be interpreted in consistent way and in general terms, such as Economy, Security and Welfare issues. Moreover, we will show that in this way cleavages between social sectors can be determined.

physics.soc-ph

On Finding the Community with Maximum Persistence Probability

The persistence probability is a statistical index that has been proposed to detect one or more communities embedded in a network. Even though its definition is straightforward, e.g, the probability that a random walker remains in a group of nodes, it has been seldom applied possibly for the difficulty of developing an efficient algorithm to calculate it. Here, we propose a new mathematical programming model to find the community with the largest persistence probability. The model is integer fractional programming, but it can be reduced to mixed-integer linear programming with an appropriate variable substitution. Nevertheless, the problem can be solved in a reasonable time for networks of small size only, therefore we developed some heuristic procedures to approximate the optimal solution. First, we elaborated a randomized greedy-ascent method, taking advantage of a peculiar data structure to generate feasible solutions fast. After analyzing the greedy output and determining where the optimal solution is eventually located, we implemented improving procedures based on a local exchange, but applying different long term diversification principles, that are based on variable neighborhood search and random restart. Next, we applied the algorithms on simulated graphs that reproduce accurately the clustering characteristics found in real networks to determine the reliability and the effectiveness of our methodology. Finally, we applied our method to two real networks, comparing our findings to what found by two well-known alternative community detection procedures.

math.OC

A Branch-and-price procedure for clustering data that are graph connected

This paper studies the Graph-Connected Clique-Partitioning Problem (GCCP), a clustering optimization model in which units are characterized by both individual and relational data. This problem, introduced by Benati et al. (2017) under the name of Connected Partitioning Problem, shows that the combination of the two data types improves the clustering quality in comparison with other methodologies. Nevertheless, the resulting optimization problem is difficult to solve; only small-sized instances can be solved exactly, large-sized instances require the application of heuristic algorithms. In this paper we improve the exact and the heuristic algorithms previously proposed. Here, we provide a new Integer Linear Programming (ILP) formulation, that solves larger instances, but at the cost of using an exponential number of variables. In order to limit the number of variables necessary to calculate the optimum, the new ILP formulation is solved implementing a branch-and-price algorithm. The resulting pricing problem is itself a new combinatorial model: the Maximum-weighted Graph-Connected Single-Clique problem (MGCSC), that we solve testing various Mixed Integer Linear Programming (MILP) formulations and proposing a new fast "random shrink" heuristic. In this way, we are able to improve the previous algorithms: The branch-and-price method outperforms the computational times of the previous MILP algorithms and the new random shrink heuristic, when applied to GCCP, is both faster and more accurate than the previous heuristic methods. Moreover, the combination of column generation and random shrink is itself a new MILP-relaxed matheuristic that can be applied to large instances too. Its main advantage is that all heuristic local optima are combined together in a restricted MILP, consisting in the application of the exact branch-and-price method but solving heuristically the pricing problem.

math.OC

Multi-attribute community detection in International Trade Network

Understanding the structure of communities in a network has a great importance in the economic analysis. Communities are indeed characterized by specific properties, that are different from those of both the individual node and the whole network, and they can affect various processes on the network. In the International Trade Network, community detection aims to search sets of countries (or of trade sectors) which have a high intra-cluster connectivity and a low inter-cluster connectivity. In general, exchanges among countries occur according to preferential economic relationships ranging over different sectors. In this paper, we combine community detection with specific topological indicators, such as centrality measures. As a result, a new weighted network is constructed by the original one, in which weights are determined taking into account all the topological indicators in a multi-criteria approach. To solve the resulting Clique Partitioning Problem and find homogeneous group of nations, we use a new fast algorithm, based on quick descents to a local optimal solution. The analysis allows to cluster countries by interconnections, economic power and intensity of trade, giving an important overview on the international trade patterns.

physics.soc-ph