Unveiling The Connectivity of Complex Networks Using Ordinal Transition Methods
Unveiling The Connectivity of Complex Networks Using Ordinal Transition Methods
Unveiling The Connectivity of Complex Networks Using Ordinal Transition Methods
methods
Juan A. Almendral,1, 2, a) I. Leyva, and Irene Sendiña-Nadal
1)
Complex Systems Group & GISC, Universidad Rey Juan Carlos, 28933 Móstoles, Madrid,
Spain
2)
Center for Biomedical Technology, Universidad Politécnica de Madrid, 28223 Pozuelo de Alarcón, Madrid,
Spain
(Dated: 13 July 2023)
Ordinal measures provide a valuable collection of tools for analyzing correlated data series. However, using
these methods to understand the information interchange in networks of dynamical systems, and uncover the
interplay between dynamics and structure during the synchronization process, remains relatively unexplored.
arXiv:2307.05739v1 [physics.soc-ph] 11 Jul 2023
Here, we compare the ordinal permutation entropy, a standard complexity measure in the literature, and the
permutation entropy of the ordinal transition probability matrix that describes the transitions between the
ordinal patterns derived from a time series. We find that the permutation entropy based on the ordinal tran-
sition matrix outperforms the rest of the tested measures in discriminating the topological role of networked
chaotic Rössler systems. Since the method is based on permutation entropy measures, it can be applied
to arbitrary real-world time series exhibiting correlations originating from an existing underlying unknown
network structure. In particular, we show the effectiveness of our method using experimental datasets of
networks of nonlinear oscillators.
concept studies involving small networks24,25 . In addi- In ordinal methods, how the raw data is projected into
tion, many of these approaches rely on multivariate pair- an ordinal series depends on the particularities of the
wise correlations to extract information4 . data, their sampling, or their continuous or discrete na-
Nevertheless, it is crucial to realize that each element ture, without affecting the rest of the procedure9 . In our
within a networked ensemble undergoes an information case, to extract information about the temporal organiza-
flux that alters its dynamics, effectively encoding valu- tion of each nodal dynamics xi (t), we first computed the
able information regarding its topological role and the two-dimensional Poincaré section P ≡ {[xi (tm ), zi (tm )] ∈
collective state. Ordinal methods serve as an ideal tool R2 | ẏi (tm ) = 0, ÿi (tm ) > 0}34 . This allows us to map the
for unveiling these dynamical changes, enabling the cre- whole attractor xi of node i into the one-dimensional
ation of centrality rankings for nodes without solely re- time series Si ≡ {yi (tm ), m = 1, . . . , M }, generated at
lying on pairwise correlations30,31 . the times tm the attractor crosses the section P. Then,
Building upon this premise, our work extends the ap- we construct the order relations of D successive data
plication of these methods to analyze the synchronization points in the sampled time series Si in the following man-
process in complex networks. Our findings demonstrate ner. Once the terms in the sequence Si are split into dis-
that ordinal transition methods outperform conventional joint blocks of size D, we create a symbolic sequence in
ordinal patterns’ statistics when it comes to detecting which each element is replaced by a number in [1, . . . , D],
subtle dynamical changes and discriminating nodes based corresponding to its relative ranking respect to its D − 1
on their topological roles. These initial results, using syn- neighbours in the block. Therefore, each block is mapped
thetic networks of chaotic Rössler systems and data from into one of the D! possible permutations in which D
experiments with nonlinear electronic circuits, illuminate different elements can be arranged. We refer to these
new possibilities for using ordinal methods in various permutations as ordinal patterns, using the notation πℓ
applications, including functional brain data analysis4 , with ℓ = 1, . . . , D!. As an example, let us consider the
power grids, mobility networks, or any other domains in- series {2.3, 3.4, −2.7, 0.4, 1.6, 2.9, −2.8, −0.5, 3.1, 2.4, . . .}.
volving the close interplay between structural and func- We first split the series into disjoint blocks of size D = 3:
tional relationships within large-scale dynamical ensem- {2.3, 3.4, −2.7}, {0.4, 1.6, 2.9}, {3.1, −0.5, 3.8}, {2.4, . . .}.
bles. Then, we derive the ordinal pattern for each block. It
can be done from maximum to minimum or the other
way around. In the first case, the ordinal patterns would
II. MODEL AND METHODS be {2, 1, 3}, {3, 2, 1}, {2, 3, 1}, . . ., which are arbitrarily
denoted as π5 , π1 , π2 , . . . (see Fig. 2 for our notation of
A. Model the six possible permutations).
Finally, we define the probability of occurrence of a
We consider a network of N identical Rössler dynam- given pattern πℓ as pℓ = #(πℓ )/L, being #(πℓ ) the num-
ical systems32 whose dynamics are governed by the fol- ber of times the ordinal pattern πℓ appears in the se-
lowing equations: quence Si and L = ⌊M/D⌋ the total number of blocks of
size D in which we divide the series Si (⌊ ⌋ is the floor
ẋi = f (xi ) − σ̃
X
Lij h(xj ), (1) function). Note that this procedure is only meaningful if
M ≫ D!.
with i = 1, . . . , N ; xi = (xi , yi , zi ) the vector state of
the node i; f (x) and h (x) : R3 → R3 , being f (x) =
[−y − z, x + ay, b + z(x − c)] the vector flow of the Rössler B. Methods
system, and h(x) = [0, y, 0]T the coupling function. We
set a = b = 0.2 and c = 9.0 to get a phase-coherent In this Section, we present the methods employed to
chaotic attractor. The coefficients Lij = ki δij − aij are characterize the statistical complexity of a nodal dynam-
the elements of the Laplacian matrix whose adjacency ics. Our ultimate objective is to establish a relationship
matrix A := (aij ) encodes the connectivity among the between the dynamical behaviour of each node and its
nodes of the network: aij = 1, if i and j are connected, structural connectivity within the network. To achieve
and aijP = 0 otherwise. Thus the degree of node i is this, we compare the ordinal permutation entropy based
σ on the probability distribution of ordinal patterns and
ki = j aij . The constant σ̃ = kmax is the coupling
strength normalized by the maximum degree present in the ordinal transition entropy based on the transition
the network, that is, kmax = max(ki ). This normaliza- probabilities between consecutive non-overlapping ordi-
tion is introduced to properly compare observables be- nal patterns.
tween different network realizations33 . The system of Permutation entropy has previously been identified as
N equations described by (1) has been numerically inte- a reliable indicator of the topological role of a node within
grated using a Runge-Kutta method of 4th order with a a dynamical network30,31 . However, our study reveals
time discretization of 0.005. In all simulations, the time that analysing the transition probabilities between ordi-
evolution is extended up to 12, 000 time units, discarding nal patterns offers a more effective and informative mea-
the first half, which is considered a transient. sure for assessing a node’s degree centrality.
3
1. Ordinal permutation entropy ment of the distribution of the Hπℓ values as in36
D!
Given the probability distribution of the ordinal pat- 1 X
HT = Hπℓ (5)
terns πℓ of size D, with ℓ = 1, . . . , D!, we define the D!
ℓ=1
normalized permutation entropy as the Shannon entropy
evaluated on the ordinal pattern probability distribution: or, alternatively, as defined in38 :
1 X D!
H0 = − pℓ ln pℓ , (2) X
ln D! ĤT = pℓ Hπl (6)
ℓ
ℓ=1
with the criterion 00 = 1 to deal the case pℓ = 0. Ac- which characterizes the weighted average (over the sta-
cording to Bandt and Pompe1 , 3 ≤ D ≤ 7 values provide tionary probabilities pℓ of each pattern πℓ ) of the diver-
reliable information on the natural complexity of time sity of consecutive ordinal patterns. Other measures to
series coming from chaotic dynamical systems as long as characterize ordinal transition networks can be found in
M ≫ D!. However, unobserved ordinal patterns have Refs.22,39 .
been reported in chaotic dynamical systems, no matter
how large the time series is, due to the underlying tem-
poral correlations35 . 3. Synchronization measures
(a)
1
Phase order, R
Sync error, E
R 10
0.8 E
0.6
5
0.4
0.2 0
0 1 2 3
Coupling strength, <
<=0.00 <=0.40 <=1.20 <=3.00
(b) (c) (d) (e)
:1 0.8
:2
0.6
:3
Thub
:4 0.4
:5 0.2
:6
0
(f) (g) (h) (i)
:1 0.8
:2
0.6
:3
Tleaf
:4 0.4
:5 0.2
:6
0
:1 :2 :3 :4 :5 :6 :1 :2 :3 :4 :5 :6 :1 :2 :3 :4 :5 :6 :1 :2 :3 :4 :5 :6
FIG. 1. OTP matrices for a star graph of N = 16 identical Rössler systems along the route to synchronization. (Top panel)
Phase order R (left axis) and synchronization error E (right axis) as a function of the coupling strength σ. (Color panels)
OTP matrices T , with ordinal patterns πℓ (ℓ = 1, . . . , 6 since D = 3), of the hub (top row) and one of the leaves (bottom
row), for the coupling values marked with dotted lines in the top panel along the synchronization process. Ordinal transitions
with zero probability are marked with dots: in white, those caused for π1 being a forbidden ordinal pattern, and in red, the
transitions that, despite being between existing ordinal patterns, they actually do not occur. Time series length M = 1000.
Rössler parameters: a = b = 0.2 and c = 9.0.
Along this route, the initially identical dynamics exhib- initial states, red dots (for instance, a π3 pattern cannot
ited by the hub and the leaves start to differentiate due follow a π5 pattern).
to the coupling interaction. This differentiation becomes As soon as the hub and the leaf interact (panels c, g
evident when examining the OTP matrix T for D = 3, and d, h), the colormap changes differently for each of
which has six ordinal patterns (corresponding to the fol- them. New transitions appear while others disappear.
lowing permutations: π1 ≡ 321, π2 ≡ 312, π3 ≡ 231, Notably, all ordinal transitions become nearly equiprob-
π4 ≡ 132, π5 ≡ 213, π6 ≡ 123). able for the hub, which is indicative of noisy dynamics—a
The colormap panels depict the OTP matrices T of the characteristic feature.
hub (b-e) and one of the leaves (f-i), representing four To closely inspect how those transitions between ordi-
different values of σ corresponding to various synchro- nal patterns evolve along the synchronization process for
nization stages. When σ = 0 (panels b, f) and σ = 0.2 each type of node in a star graph, we plot in each panel of
(panels e, i), the hub and the leaves’ OTP matrices ex- the top row of Fig. 2 the node permutation entropy Hπℓ of
hibit the same color coding. This similarity arises be- each ordinal pattern πℓ for the hub and one of the leaves
cause they describe the transition probabilities between and the corresponding ordinal pattern frequencies pπℓ at
ordinal patterns of the same intrinsic dynamics, given by the bottom row as a function of the coupling strength σ.
the flow f in Eq. (1) when the systems are uncoupled or The most remarkable differences between hub and leaf
coupled but synchronized. In these panels, white and red come from those transitions starting at patterns π1 , π4 ,
dots indicate unobserved ordinal transitions (pℓm = 0). and π5 , since the gap between the node permutation en-
These transitions may be absent either because the cho- tropies Hπ between hub and leaf is the largest, while for
sen chaotic dynamics include one forbidden ordinal pat- the rest of patterns is less pronounced. In particular, the
tern, white dots (caused by the forbidden pattern π1 ), or pattern π1 , which is forbidden in the isolated dynamics,
because unreachable ordinal patterns exist from certain not only emerges due to the interaction but also becomes
5
H:
1 :1 1 :2 1 :3 1 :4 1 :5 1 :6
p:hub 0.5
0.2 p:leaf 0.2 0.2
0.2 0.1
p:
0.1 0.1
0 0 0 0 0 0
0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3
< < < < < <
FIG. 2. Evolution of the node permutation entropies Hπℓ (top row) and the corresponding probabilities pπℓ (bottom row) of
each ordinal pattern πℓ , for D = 3, as a function of the coupling σ (crosses for the hub and dots for one of the leaves). Notice
that the scale is not the same for all the panels at the bottom row. In the upper right corner of the panels in the top row, it
is shown schematically with three black dots the permutation of the corresponding ordinal pattern (for instance, π2 is 312 and
π3 is 231). Data is for the same N = 16 star of Rössler systems and parameters as in Fig. 1.
much more entropic in the hub’s dynamics than in the as they have the same degree, kleaf = 1. This finding
leaves. In addition, note the differences in the probability implies that the network permutation entropy HT has
frequency pπ of each pattern that will have an effect on the potential for effectively discerning topological roles
the network permutation entropy of the OTN as defined within more complex ensembles, as we will explore in the
in Eq. (6). next Section.
The primary objective of this work is to evaluate
whether an entropic measure based on the information
encoded in the OTN can outperform the predictive power B. Scale-free network
of the entropic quantifiers based on just the probability
distribution of the ordinal patterns. To examine this, Once we have evidence that the network permutation
we compare in Fig. 3 how the ordinal permutation en- entropy HT can uncover the information stored in the
tropy H0 [Eq. (2)] and the network permutation entropies OTN and discriminate the different roles that nodes have
HT [Eq. (5)] and ĤT [Eq. (6)] differentiate between the in star networks, we move forward to test this measure
hub and leaf dynamics for two star networks of N =9 in the more challenging task of analyzing the synchro-
and N =31 nodes. The network permutation entropy nisation process of a scale-free network. Precisely, we
HT (panel (b)) effectively separates the hub and leaf dy- consider the network dynamics of N = 300 nodes, as de-
namics right from the onset of phase synchronization, scribed by Eq. (1), whose connectivity follows a scale-free
and maintains this distinction over a broader range of degree distribution41 .
coupling strengths compared to the two other entropies. Given a coupling value σ, for each node i we compute
(i)
This is linked to the results shown in Fig. 2, in which the corresponding ordinal permutation entropy H0 and
those patterns with the greatest differences between hub (i)
the network permutation entropy HT . Since we expect
and leaf node permutation entropies (π1 , π4 and π5 ) are that the nodes with the same degree k will have the same
those for which the probabilities of occurrence are smaller dynamical role within the network, we define a k-class
than for the rest (π2 , π3 , and π6 ). Note that the scale average for the network permutation entropies as30 :
is not the same for all the panels. Consequently, the
weighted version of the network permutation entropy, 1 X (i)
⟨HT ⟩k = HT , (9)
ĤT , is biased by the most frequent patterns π2 , π3 , and Nk
{i|ki =k}
π6 which are the ones with the most similar hub and
leaf node permutation entropies and there, less sensitive where Nk is the number of nodes with degree k and ⟨⟩k
to distinguish between the nodes’ different roles in the is just to denote how the measure has been obtained as
collective dynamics. an ensemble average of the given measure at the node
Furthermore, a noteworthy observation is that the dif- level restricted to nodes with the same connectivity k.
ferentiation in the HT of the hub is more pronounced, Similarly, we define a k-class average for the ordinal per-
and occurs at a lower coupling strength, in the case of mutation entropies of those nodes with the same degree:
the larger star with N = 31, compared to the smaller ⟨H0 ⟩k .
one with N = 9. On the other hand, the values for the The results are presented in Fig.4, which compares
leaf nodes in both stars are similar, which is expected ⟨H0 ⟩k (a,c) and ⟨HT ⟩k (b,d). It is clear that the net-
6
^T
HT
H0
H
0.4 0.5 N=31,hub 0.4 0.5 0.4 0.5
^Tj
j"HT j
j"H0 j
j"H
N=9,hub
N=31,leaf
0.2 0 N=9,leaf
0.2 0 0.2 0
0.01 0.1 0.01 0.1 0.01 0.1
</N-1 </N-1 </N-1
0 0 0
0 0.05 0.1 0.15 0 0.05 0.1 0.15 0 0.05 0.1 0.15
< < <
Coupling strength, N !1 Coupling strength, N !1 Coupling strength, N !1
FIG. 3. Comparison between (a) the ordinal permutation entropy H0 , and (b) the weighted ĤT and (c) unweighted HT network
permutation entropies along the route to synchronization, for the hub (blue crosses) and one of the leaves (red dots), of a star
graph of size N = 9 (dotted curves) and N = 31 (solid curves). Insets show, in a log-linear scale, the absolute difference
between the entropies of hub and leaf (∆H0 = H0hub − H0leaf , and the same for ∆ĤT and ∆HT ).
work permutation entropy surpasses the ordinal permu- N = 28 electronic circuits coupled in 20 different network
tation entropy in its ability to sort nodes according to configurations and monitored along their synchronization
their degree. Upon increasing the normalized coupling process for 100 coupling levels, ranging from disconnec-
strength σ/kmax , both entropies exhibit a distinct sepa- tion (isolated nodes) to values producing a network state
ration based on node degrees. However, the differences of complete synchrony. Please refer to the reference44 for
between k-classes are more pronounced in the case of a full description of the experiments.
⟨HT ⟩k . Therefore, these experimental datasets provide the
It is worth noting that, for weak values of the cou- ideal testbed for our inference method and to predict the
pling network, hubs exhibit higher entropy values, simi- circuits connectivity by means of the network permuta-
lar to the behavior of the central node of a star network. tion entropy of each timeseries’ circuit. In order to do so,
However, as the synchronization progresses further, the we choose a weak coupling condition (level 9 over 100)
ranking of the degree classes reverses. This change in be- and, for only one of the network configurations [the one
haviour throughout the synchronization process reflects that is used as a ground truth reference, plotted in Fig.
an interesting fact: in weakly coupled networks, highly 5 (a)], we calculate the average k-class network permu-
connected nodes perceive the information from the net- tation entropy ⟨HT ⟩k .
work as a source of noise, thereby increasing their entropy The output of this calibration procedure is a function
above that of the low-connected nodes. However, beyond that maps the node degree classes of the network used as
this point, the highly connected nodes take the lead in a ground truth and the corresponding assigned network
driving the transition to coherence, while the other nodes permutation entropies. One possible way is to produce
remain unsynchronized42,43 , resulting, as a consequence, a piecewise function ka (HT ) such that the sequence of
in an exchange of entropy trends. intervals are defined by interpolating the entropies mea-
sured in the experiment used as calibration for the de-
The results shown in Figs. 4(b,d) shed light on under-
grees k and k + 1, that is, TH (k) = [⟨HT ⟩k+1 − ⟨HT ⟩k ]/2
standing this entropy-based centrality ranking. We plot
for k = 1, . . . , kmax − 1. Now, for each node i in any
the ordinal permutation entropy (b) and the network per-
network different from the one used as a reference, we
mutation entropy (d) as a function of k for various cou-
blindly assign a degree ka as a function of their dynam-
pling values. The entropies of the degree classes demon-
ics using the following map:
strate a quasi-linear relationship with k, displaying a pos-
itive slope for weak coupling (solid lines) and a negative 1 if HTi
< TH (1)
slope for coupling strengths close to the system’s synchro- i i
ka = k if TH (k) < HT < TH (k + 1); k = 2, . . . , kmax − 1
nization (dashed lines). Therefore, network permutation i
kmax if HT > TH (kmax − 1)
entropy measures stand out as a superior choice. Con- (10)
sequently, a centrality ranking can be established solely Since the real degree kri of the node i is available in the
based on this entropy without prior knowledge of the un- dataset, we can compare the predicted value kai with the
derlying structure or costly pairwise computations of the real one. In Fig. 5(b), we plot the assigned degree versus
observed time series. the real one averaged for all the nodes in the 19 networks.
To assess the method’s validity in a more realistic envi- Notice that these networks are very small and relatively
ronment with available ground truth structural informa- sparse, with a maximum degree kmax = 7 and, there-
tion, we analysed the experimental datasets of networks fore, the degree sequence spans a much narrower interval
of nonlinear electronic circuits provided by Ref.44 . These than in the SF networks used in the simulations shown
datasets comprise the time series of the output voltage of in Fig. 4. Remarkably, even in this degree-constrained
7
E k=3 k=20
hH0 ik
R k=5 k=30
0.5 k=2 k=10 <=0 <=0.01
<=0.005 <=0.15
<=0.007 <=0.17
(a) (b)
0
1
hHT ik
0.5
(c) (d)
0
0 0.05 0.1 0.15 0.2 5 10 15 20 25 30
<
Coupling strength kmax Node degree k
FIG. 4. Comparison between the k-class ordinal permutation entropy ⟨H0 ⟩k (a,c) and the k-class network permutation entropy
⟨HT ⟩k (b,d) for heterogeneous scale-free networks of N = 300 nodes and mean degree 4: (a,b) as a function of the normalized
σ
coupling strength kmax , for several values of degree k class; (c,d) as a function of k, for several values of σ. In panel (d),
solid lines refer to weak coupling values while dashed ones refer to couplings favoring a state close to synchronization. The
synchronization error E (rescaled for clarity) and the Kuramoto parameter R have been added in panel (a) as a reference. Each
curve is the result of averaging over 50 network instances. Shaded bands indicate the confidence interval around the mean
value computed as three times the standard error of the mean.
6
assessed the performance of the standard ordinal permu-
5 tation entropy H0 compared to the network permutation
entropy HT , which captures information about transi-
4
tions between ordinal patterns, and applied the proposed
3
methodology to infer the connectivity of experimental
datasets of networks of nonlinear circuits.
2 Whereas there exist other measures, such as statisti-
cal permutation complexity30 and ordinal structurality31 ,
1
1 2 3 4 5 6 7 which have demonstrated their usefulness as proxies for
Real degree kr degree distributions, our findings highlight the ordinal
transition entropy as a more effective method for distin-
FIG. 5. Inference of the nodes’ degree of networks of elec- guishing topological roles, and producing more satisfac-
tronic circuits based on the k-class network permutation en- tory outcomes, particularly for lower embedding dimen-
tropy ⟨HT ⟩k of the timeseries reported in Ref.44 . (a) Struc-
sions.
ture connectivity of the electronic circuit network used as a
ground truth. (b) Average assigned degree ka versus the real Many methods focused on the structure-function re-
degree kr obtained when using a single network as a training lationship are primarily intended to infer the detailed
reference. connectivity network, down to the level of the individual
links, from time series. However, in many cases, knowl-
edge of centrality roles alone is sufficient for designing
successful interventions in the dynamics. Therefore, we
8
anticipate that our results, which do not rely on pairwise 17 X. Wang, X. Han, Z. Chen, Q. Bi, S. Guan, and Y. Zou, “Multi-
correlations between timeseries, will be of particular in- scale transition network approaches for nonlinear time series
terest in the context of functional networks and other analysis,” Chaos, Solitons and Fractals 159, 112026 (2022).
18 K. Peng and P. Shang, “Characterizing ordinal network of time
scenarios in which the underlying structural information series based on complexity-entropy curve,” Pattern Recognition
is inaccessible. 124, 108464 (2022).
19 G. Nicolis, A. G. Cantú, and C. Nicolis, “Dynamical aspects of
ical, Physical and Engineering Sciences 375, 20160292 (2017). 42 C. Zhou and J. Kurths, “Hierarchical synchronization in
38 A. M. Unakafov and K. Keller, “Conditional entropy of ordinal complex networks with heterogeneous degrees,” Chaos: An
patterns,” Physica D: Nonlinear Phenomena 269, 94–102 (2014). Interdisciplinary Journal of Nonlinear Science 16 (2006),
39 M. Zanin and F. Olivares, “Ordinal patterns-based methodolo- 10.1063/1.2150381, 015104.
gies for distinguishing chaos from noise in discrete time series,” 43 T. Pereira, “Hub synchronization in scale-free networks,” Phys.