You are on page 1of 6

Home Search Collections Journals About Contact us My IOPscience

Computing with complex-valued networks of phase oscillators

This article has been downloaded from IOPscience. Please scroll down to see the full text article.

2013 EPL 102 40007

(http://iopscience.iop.org/0295-5075/102/4/40007)

View the table of contents for this issue, or go to the journal homepage for more

Download details:
IP Address: 138.4.131.148
The article was downloaded on 25/07/2013 at 12:03

Please note that terms and conditions apply.


May 2013
EPL, 102 (2013) 40007 www.epljournal.org
doi: 10.1209/0295-5075/102/40007

Computing with complex-valued networks of phase oscillators


M. Zanin1,2,3 , D. Papo1 and S. Boccaletti4
1
Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo
28223 Pozuelo de Alarcón, Madrid, Spain, EU
2
Faculdade de Ciências e Tecnologia, Departamento de Engenharia Electrotécnica, Universidade Nova de Lisboa
Lisboa, Portugal, EU
3
Innaxis Foundation & Research Institute - José Ortega y Gasset 20, 28006, Madrid, Spain, EU
4
CNR - Institute of Complex Systems - Via Madonna del Piano 10, 50019 Sesto Fiorentino, Florence, Italy, EU

received 1 March 2013; accepted in final form 14 May 2013


published online 10 June 2013

PACS 05.45.Xt – Synchronization; coupled oscillators


PACS 02.10.Ox – Combinatorics; graph theory
PACS 89.20.Ff – Computer science and technology

Abstract – A computational paradigm based on phase-locked states of oscillators embedded in


a complex-valued weighted network is introduced, and its efficiency and scalability in performing
single- and multiple-input Boolean and non-Boolean operations are demonstrated. The paradigm
introduces phase rotation mechanisms in each link of the network, without the need for
external control loops, or adaptive mechanisms. We show that the proposed computation allows
outperforming standard implementations of Boolean logic, by reducing the computational cost of
operations, and permitting the construction of memory elements with single dynamical units.

c EPLA, 2013
Copyright 

Introduction. – Representing information and as complex numbers. Classically, networked units interact
computing by means of systems composed of dynamical by means of real-valued coupling strengths. Here, instead,
units has attracted huge attention in recent years in fields the use of complex weights allows not only setting the
as diverse as cellular automata [1], lattices of coupled coupling by means of their moduli, but also introducing
chaotic maps [2], chemical and neuronal diodes [3,4], phase rotations through their arguments. For oscillators
patterned neuronal cultures [5] and chaotic neurons [6], in a frequency-locked regime, such a coupling scheme
or coupled non-linear systems [7,8]. The most promis- creates multiple stable phase-locked states, which can
ing methods are possibly those constructing Boolean codify information by means of the difference between the
ports with chaotic circuits (the so-called chaos comput- oscillator’s phase and that of a global reference. We show
ing [2,9,10]), or using adaptive mechanisms [11,12]. How- how such an information can be processed efficiently, and
ever, the former requires an external control to force the how Boolean as well as non-Boolean (i.e., not restricted
dynamics into a desired state, the latter implies a fast to 0 and 1 states) representations can be constructed.
timescale for adaptation which is not always easy to imple-
ment. On the other hand, how ensembles of oscillators Description of the model. – Without loss of gener-
embedded in a (complex) network [13,14] collectively orga- ality, we illustrate our findings for N Kuramoto-like oscil-
nize into a synchronized evolution has widely been studied lators which, both for their simplicity and analytical
both theoretically and experimentally [15,16]. The use of tractability, constitute a benchmark model for the study
such synchronous states for computation is an issue of of synchronization of networked phase oscillators. The
the utmost importance, particularly due to their inherent main difference with respect to the classical case [19]
relevance to the understanding of processes taking place in is that here the network supporting the interactions is
the brain, where the synchronization of groups of neurons complex-valued, i.e., each element of the weight matrix
is one of the milestones of neural computation [17,18]. wij is a complex number. The system under study is then
In this letter, we show how computation can naturally defined as
be associated to phase-locked states of oscillators, once the

latter are the nodes of a complex-valued weighted graph, θ̇i = ω + λ |wji | sgn [sin (θj + arg wji − θi )]. (1)
i.e., when the interactions between oscillators are defined j=i

40007-p1
M. Zanin et al.

Performing higher-level Boolean operations requires


building a NOR gate, one of the two universal Boolean
NOT gate
gates, from which any other static Boolean function can
I -1 Output be derived [20,21]. The NOR gate has two inputs and
one output; the output value is 1 only when both inputs
are at a logical state 0, and 0 otherwise. Figure 2 shows
the representation of the NOR gate (where reference and
input signals are all entering the computing oscillators
with weights −1), together with the corresponding time
Fig. 1: (Color online) Left: time evolution of the phase of evolutions of all signals involved in it. Three different
two oscillators, when the coupling weight between the master dynamics can emerge from this configuration. Due to the
(black solid line) and the slave (blue dashed line) is −1. After π phase shift introduced by each incoming link, when both
an initial transient, both oscillators synchronize with a phase inputs are 0, the computing node is driven toward the 1
difference of π. Right: schematic representation of the circuit dynamics, and the reference signal is unable to block the
creating such a dynamics, that corresponds to a NOT Boolean expression of this state. However, inputs in opposite states
gate. (1 − 0 or 0 − 1) cancel out, as their coupling forces push
in opposite directions; the reference signal with weight
w = −1 then drives the computing node toward the 0 state.
In eq. (1), θi is the phase of oscillator i (i = 1, . . . , N ), Finally, if both inputs are 1, the computing node is driven
ω is the natural frequency common to all oscillators, λ toward 0. In summary, the 1 state will only be expressed
is a global coupling parameter, and |wji | and arg wji are, if both input dynamics are in the 0 state (see the time
respectively, the module and the argument of the weight evolution of the signals reported in fig. 2).
of the link connecting node j to node i. Notice that the While in fig. 2, for the sake of clarity, all coupling
sgn function discretizes to either 1 or −1 the value of the strengths have been set to 1, it should be noticed that
output of the sin function. this requirement can easily be relaxed. As previously
The functioning of complex-valued coupling can be explained, in order to have both inputs cancel out when
illustrated for two oscillators i and j with different initial they have opposite states, i.e., 1 − 0 or 0 − 1, their corre-
phases and arranged in a master-slave configuration. The sponding coupling strengths should be equal, so that the
argument of the sin function in eq. (1) explicitly contains only input effectively acting over the oscillator is the refer-
the argument of the complex weight wji . If arg wji = 0, the ence state. In this case, any positive strength will be
stable phase-locked state only corresponds to equal phases enough for the reference state to lock the oscillator into the
of oscillators i and j. More generally, such a phase-locked desired dynamics. On the other hand, when both inputs
state, for which no coupling force is generated, is defined have the same state, i.e., 0 − 0 or 1 − 1, their combined
by θj − θi = − arg wji . For instance, when wji = −1, the signals should be greater than the one corresponding to
slave oscillator eventually synchronizes with the master, the reference state. Summing up, if we define the strength
but with a phase difference of π. Figure 1 illustrates this corresponding to the two inputs as σ, the emergence of the
scenario. correct computation is guaranteed as long as the strength
In the following, we describe the way the multiple of the reference state is in the (0, 2σ) range.
phase-locked states that may be produced via eq. (1) It must be noticed that the value of σ, and more
can conveniently be exploited for computing. Performing generally of the coupling strengths, determines the time
computation requires a reliable mean of representing required to reach the phase-locked state. In principle,
information, so that it can be stored, retrieved, and the higher such strengths, the smaller the convergence
manipulated efficiently; for instance, in the standard time. Yet, since the value of the coupling is introduced
Boolean logic used in microprocessors, the information is in the oscillator dynamics through the sign of the sine
represented by means of two electrical states, 0 and 1. of phases difference (and not just though the sine, as in
We start by encoding information in the phase difference the standard Kuramoto equation), strong couplings may
between oscillators in the frequency-locked state. The 1 introduce oscillations of the phase around the phase-locked
state is defined by the dynamics of a reference pacemaker state; this, in turn, can introduce noise in the output
oscillator; on the other hand, the 0 state is given by the signal, which may propagate through all computation
signal rotated by an angle π with respect to the 1 state. elements. Therefore, when high computation velocity is
In fact, the example with two oscillators connected with required, both the strengths and the integration time step
a weight of −1 is fully equivalent to a NOT gate (see again should be chosen accordingly.
fig. 1). Given a generic input, the output is always rotated Figure 3 shows the connection patterns corresponding to
by an angle π, and is therefore always the result of a some other important Boolean gates. To obtain a NAND
NOT Boolean operation on the input: when the oscillator i gate (the second universal Boolean gate), one only needs to
generates the reference signal (i.e., the 1 state), the output modify the NOR configuration, and change to 1 the weight
of node j is the logical state 0, and vice versa. of the reference signal input. Furthermore, changing the

40007-p2
Computing with complex-valued networks of phase oscillators

NOR gate
R
-1
I1 -1 Output
I2
-1

Fig. 2: (Color online) Left: computation of a NOR function. From top to bottom, time evolutions refer to: the reference oscillator
(used to represent 1 bits), the 0 reference signal (created with a NOT gate applied to the reference oscillator), the two inputs
signals, and the output signal. Black solid lines represent a 1 status, while red dashed lines represent 0 bits. Right: schematic
representation of the connections required to construct the NOR gate.

NAND gate AND gate Majority gate


R R R
+1 -1 I1 +1 +0.5
I1 -1 Output I1 +1 Output I2 +1 Output
I2 I2 I3 +1
-1 +1

Fig. 3: Schematic representations of the connections required to construct the NAND, AND and majority Boolean gates.

sign of all weights of the NAND gate results in the couplings representing interactions between them; the
complementary AND gate. A first important conclusion state of each spin then codifies a Boolean value. Yet,
can be drawn: a complex-valued directed network of phase the most important advantage of the proposed frame-
oscillators, in which weight moduli are set to 1, already work is represented by the possibility of breaking away
allows performing any Boolean operation (in the sense from the classical 2-state Boolean information processing.
of a Turing machine), with each specific operation (i.e., In the previous examples, the 2-state representation was
combination of NAND and NOR gates) corresponding to constructed by starting from a reference signal, represent-
a given motif of the network [22]. ing a 1 state, and rotating the phase by π to obtain the
Several further noticeable advantages result when the logical 0 value. The idea can, in fact, be extended to repre-
oscillators are embedded in a fully weighted network, sent information with  states, if the signal corresponding
i.e., by no longer imposing that the weights’ modulus be to each state is obtained by rotating the reference signal
unitary. The first is to drastically reduce the complexity by 2 πk (with k = 0, . . . ,  − 1).
of some Boolean operations. One example is the config- The ability to codify multiple states has many impor-
uration associated to the majority gate (the third gate tant consequences. For instance, it allows considering the
of fig. 3), a circuit whose output is 1 if the majority of signal as a number in base , so that each node encodes
the inputs are equal to 1, and zero otherwise. Remark- an integer number between 0 and  − 1. By appropriately
ably, while our method only requires one oscillator to connecting nodes, various numerical operations can be
perform the majority operation, independently of the performed. In fig. 4 the simple case of the increment (the
number n of inputs, in standard Boolean logic the major- addition of 1 to the input number) is achieved for  = 4,
ity gate is known to have a complexity of O(n5.3 ), and by rotating the phase of the input signal by an angle of
π
cannot be computed by AC0 circuits of sub-exponential 2 . Once again, while standard Boolean logic requires at
size [23]. least 7 gates to build an increment operation with three
bits [20,21], our method only requires one oscillator. This
n-state computation. – At this point, it should be advantage becomes increasingly conspicuous the larger the
noticed that most of the proposed results can be obtained value of , as here only one oscillator is required indepen-
by means of other discrete physical systems. For instance, dently of the number of states that need to be unitarily
oscillators may be substituted by Ising spins [24], with incremented.

40007-p3
M. Zanin et al.

Boolean memory Four-state memory


Increment 0 1
Set 1
1
πi Output 1/2 π i
e 2
Reset
Output
I -1 π
-1
3/2 π -i

Fig. 4: (Color online) Left: schematic representation of the Fig. 6: Schematic representations of a Boolean (left) and a
increment circuit. The Kuramoto oscillator is synchronized multi-state (right) memory circuit.
with the input signal, but with a phase rotation of π/2: in a
representation with base  = 4, this is equivalent to increment
the number by one. Right: representation of the dynamics of
the coupling mechanism. The green small circle represents the
phase of the input signal; green arrows depict the resulting
coupling forces.

Median value
R
-0.5
+1
I
+1 Output
I
+1
I

Fig. 5: (Color online) Top: schematic representation of the


median value circuit. Bottom: examples of the coupling forces
for two different sets of 4 inputs (represented by the small
green circles). Solid green arrows indicate the coupling force Fig. 7: (Color online) Robustness to noise of the computa-
resulting from each input, while the red dashed arrows indicate tional paradigm. Black solid and blue dashed lines respectively
the resulting coupling force. An additional input, represented represent the robustness to noise of a NOR gate and of a circuit
by a small blue square and connected to the reference time composed of a NOR gate followed by 4 NOT gates in a linear
series with weight w = −0.5, is used to resolve tied situations. chain configuration. Top: mean squared error of the output.
Bottom: number of erroneously codified bits for a Boolean
NOR gate, for different standard deviations of a white Gaussian
Figure 5 shows another operation on multiple inputs noise added to the gates’ inputs.
(the calculation of the median value) that we can perform
with just a single unit. Each of the inputs, with coupling
the most important of which being a memory. Figure 6,
strength 1, attracts the oscillator toward its corresponding
phase value: the output phase, therefore, will represent left, depicts the circuit associated to a Boolean set reset
the median of the distribution of inputs. Notice that an flip-flop. When the set (reset) input has a value of 1,
auxiliary input is connected with strength −0.5 to the the dynamics of the unit is attracted toward the 1 (0)
reference value R, i.e., the signal corresponding to the state; afterwards, when all inputs have a 0 value, they
numerical value 0: this is used to resolve tied situations cancel out, and the oscillator can follow its own dynamics
when the number of inputs is even. —effectively maintaining the previously imposed state. It
is worth noticing that no feedback loop is required, as the
Dynamical gates. – So far, we concentrated on motifs dynamics of the oscillator in the free regime is already a
representing static gates, where the output solely depends function of its own past. Figure 6, right, expands this idea
on the actual status of the inputs. Yet, our paradigm to the case of multiple states (namely, for  = 4). When
can easily be expanded to encompass dynamical gates, one of the four inputs has a value of 1, the dynamics of

40007-p4
Computing with complex-valued networks of phase oscillators

the oscillator is forced towards the state represented by ∗∗∗


that input (from top to bottom, 0, 1, 2 and 3); when all
four inputs are set to 0, the unit maintains memory of its Work supported by the BBVA-Foundation within the
previous state. Isaac-Peral program of Chairs. Authors acknowledge
Robustness against noise. – As a last topic, we Ruedi Stoop for many useful discussions, and the usage of
discuss the issue of robustness of the system against the resources, technical expertise and assistance provided
noise contamination, due to its relevance for real-world by supercomputing facility CRESCO of ENEA in Portici
applications. Equation (1) represents the noiseless case (Italy).
of identical oscillators (ω = ω1 , ω2 , . . . , ωN ), for which it
is well known that the phase-locked state is a point
REFERENCES
in the unit circle. As a consequence, an in principle
infinite number of states can be encoded by means of
[1] Toffoli T. and Margolus N., Cellular Automata
suitable phase rotations. In the presence of noise or
Machines: A New Environment for Modeling (MIT Press)
heterogeneity in oscillator frequencies, or when using 1987.
chaotic phase-coherent oscillators instead of Kuramoto [2] Sinha S. and Ditto W. L., Phys. Rev. Lett., 81 (1998)
ones, the phase-locked state corresponds to a region, and 2156.
the number  of states encodable in an error-free way is [3] Steinbock O., Kettunen P. and Showalter K.,
reduced. In particular, noise can induce 2π phase slips, J. Phys. Chem., 100 (1996) 18970.
corresponding to jumps from different local minima of [4] Motoike I. and Yoshikawa K., Phys. Rev. E, 59 (1999)
the washboard potential landscape [15], and these may 5354.
introduce transitory errors in the information codified [5] Feinerman O., Rotem A. and Moses E., Nat. Phys., 4
by each oscillator. Figure 7 illustrates the robustness (2008) 967.
[6] Ikeda M., Horio Y. and Aihara K., J. Signal Process.,
to noise of our method. Here we consider two different
16 (2012) 291.
configurations: a simple NOR gate (solid black lines
[7] Murali K., Sinha S., Ditto W. L. and Bulsara A. R.,
in fig. 7), and a more complex circuit composed of a Phys. Rev. Lett., 102 (2009) 104101.
NOR gate followed by four NOT gates in a linear chain [8] Storni R., Ando H., Ahiara K., Murali K. and Sinha
(dotted blue lines). Each input port of all gates receives a S., Phys. Lett. A, 376 (2012) 930.
different realization of a white Gaussian noise of amplitude [9] Murali K., Miliotis A., Ditto W. L. and Sinha S.,
σ, and the resulting output robustness is quantified in Phys. Lett. A, 373 (2009) 1346.
terms of the mean squared error, and of the fraction [10] Ditto W. L., Miliotis A., Murali K., Sinha S. and
of erroneously codified bits. Computation appears to be Spano M. L., Chaos, 20 (2010) 037107.
robust up to a critical value σc = 2 of noise amplitude, [11] Zanin M., Papo D., Sendina-Nadal I. and
above which, phase slips start affecting computation, and Boccaletti S., Phys. Rev. E, 84 (2011) 060102.
[12] Zanin M., del Pozo F. and Boccaletti S., PLoS ONE,
the results are no longer reliable. Yet, the value of σc is
6 (2011) e26467.
high enough to ensure applicability of the paradigm in real
[13] Boccaletti S., Latora V., Moreno Y., Chavez M.
electronic circuits. Furthermore, it should be noticed that and Hwang D-U., Phys. Rep., 424 (2006) 175.
the complex circuit is slightly more resilient to noise than [14] Albert R. and Barabasi A.-L., Rev. Mod. Phys., 74
a single gate, especially in the range 2.5 < σ < 3.5: this (2002) 47.
indicates that different noises cancel out when multiple [15] Boccaletti S., Kurths J., Osipov G., Valladares
gates, i.e., multiple oscillators, are connected together, D. L. and Zhou C. S., Phys. Rep., 366 (2002) 1.
increasing the applicability of the proposed computation [16] Arenas A., Dı́az-Guilera A., Kurths J., Moreno Y.
scheme. and Zhou C. S., Phys. Rep., 469 (2008) 93.
[17] Abeles M., Corticonics: Neural Circuits of the Cerebral
Conclusions. – In this letter, we introduced a novel Cortex (Cambridge University Press) 1991.
computational paradigm, based on a modified synchro- [18] Varela F., Lachaux J.-P., Rodriguez E. and
nization mechanism between oscillators embedded in Martinerie J., Nat. Rev. Neurosci., 2 (2001) 229.
complex-valued networks. We demonstrated that this [19] Kuramoto Y., Chemical Oscillations, Waves and Turbu-
paradigm performs standard single- and multiple-input lence (Springer) 1984.
Boolean gates efficiently and in a scalable way, represents [20] Roth C. H. and Kinney L. L., Fundamentals of Logic
multi-state information beyond classical Boolean codes, Design (Cengage Learning) 2010.
[21] Bartee T. C., Computer Architecture and Logic Design
and can carry out dynamical operations. These results
(McGraw-Hill) 1991.
are of value both from a technological point of view (as
[22] Milo R., Shan-Orr S., Itzkovitz S., Kashtan N.,
they allow constructing simple circuits that outperform Chklovskii D. and Alon U., Science, 298 (2002)
the standard Boolean ones), and from the viewpoint 824.
of theoretical neuroscience, as they suggest possible [23] Valiant L., J. Algorithms, 5 (1984) 363.
mechanisms of information processing and integration in [24] Newell G. F. and Montroll E. W., Rev. Mod. Phys.,
distributed neural systems [17,18]. 25 (1953) 353.

40007-p5

You might also like