May 1, 2014, Filed Under: PublicationsA Transition to Sharp Timing in Stochastic Leaky Integrate-and-Fire Neurons Driven by Frozen Noisy Input Citation: Taillefumier T, Magnasco M. A Transition to Sharp Timing in Stochastic Leaky Integrate-and-Fire Neurons Driven by Frozen Noisy Input. Neural Computation [Internet]. 26 (5) :819 – 859. Publisher’s Version Abstract The firing activity of intracellularly stimulated neurons in cortical slices has been demonstrated to be profoundly affected by the temporal structure of the injected current (Mainen & Sejnowski, 1995). This suggests that the timing features of the neural response may be controlled as much by its own biophysical characteristics as by how a neuron is wired within a circuit. Modeling studies have shown that the interplay between internal noise and the fluctuations of the driving input controls the reliability and the precision of neuronal spiking (Cecchi et al., 2000; Tiesinga, 2002; Fellous, Rudolph, Destexhe, & Sejnowski, 2003). In order to investigate this interplay, we focus on the stochastic leaky integrate-and-fire neuron and identify the Hölder exponent H of the integrated input as the key mathematical property dictating the regime of firing of a single-unit neuron. We have recently provided numerical evidence (Taillefumier & Magnasco, 2013) for the existence of a phase transition when H becomes less than the statistical Hölder exponent associated with internal gaussian white noise (H=1/2). Here we describe the theoretical and numerical framework devised for the study of a neuron that is periodically driven by frozen noisy inputs with exponent H>0. In doing so, we account for the existence of a transition between two regimes of firing when H=1/2, and we show that spiking times have a continuous density when the Hölder exponent satisfies H>1/2. The transition at H=1/2 formally separates rate codes, for which the neural firing probability varies smoothly, from temporal codes, for which the neuron fires at sharply defined times regardless of the intensity of internal noise.
March 27, 2013, Filed Under: PublicationsA phase transition in the first passage of a Brownian process through a fluctuating boundary with implications for neural coding Citation: Taillefumier T, Magnasco MO. A phase transition in the first passage of a Brownian process through a fluctuating boundary with implications for neural coding. PNAS [Internet]. 110 (16) :E1438 – E1443. Publisher’s Version Abstract Finding the first time a fluctuating quantity reaches a given boundary is a deceptively simple-looking problem of vast practical importance in physics, biology, chemistry, neuroscience, economics, and industrial engineering. Problems in which the bound to be traversed is itself a fluctuating function of time include widely studied problems in neural coding, such as neuronal integrators with irregular inputs and internal noise. We show that the probability p(t) that a Gauss–Markov process will first exceed the boundary at time t suffers a phase transition as a function of the roughness of the boundary, as measured by its Hölder exponent H. The critical value occurs when the roughness of the boundary equals the roughness of the process, so for diffusive processes the critical value is Hc = 1/2. For smoother boundaries, H > 1/2, the probability density is a continuous function of time. For rougher boundaries, H < 1/2, the probability is concentrated on a Cantor-like set of zero measure: the probability density becomes divergent, almost everywhere either zero or infinity. The critical point Hc = 1/2 corresponds to a widely studied case in the theory of neural coding, in which the external input integrated by a model neuron is a white-noise process, as in the case of uncorrelated but precisely balanced excitatory and inhibitory inputs. We argue that this transition corresponds to a sharp boundary between rate codes, in which the neural firing probability varies smoothly, and temporal codes, in which the neuron fires at sharply defined times regardless of the intensity of internal noise.
December 1, 2012, Filed Under: PublicationsExact Event-Driven Implementation for Recurrent Networks of Stochastic Perfect Integrate-and-Fire Neurons Citation: Taillefumier T, Touboul J, Magnasco M. Exact Event-Driven Implementation for Recurrent Networks of Stochastic Perfect Integrate-and-Fire Neurons. Neural Computation [Internet]. 24 (12) :3145 – 3180. Publisher’s Version Abstract In vivo cortical recording reveals that indirectly driven neural assemblies can produce reliable and temporally precise spiking patterns in response to stereotyped stimulation. This suggests that despite being fundamentally noisy, the collective activity of neurons conveys information through temporal coding. Stochastic integrate-and-fire models delineate a natural theoretical framework to study the interplay of intrinsic neural noise and spike timing precision. However, there are inherent difficulties in simulating their networks’ dynamics in silico with standard numerical discretization schemes. Indeed, the well-posedness of the evolution of such networks requires temporally ordering every neuronal interaction, whereas the order of interactions is highly sensitive to the random variability of spiking times. Here, we answer these issues for perfect stochastic integrate-and-fire neurons by designing an exact event-driven algorithm for the simulation of recurrent networks, with delayed Dirac-like interactions. In addition to being exact from the mathematical standpoint, our proposed method is highly efficient numerically. We envision that our algorithm is especially indicated for studying the emergence of polychronized motifs in networks evolving under spike-timing-dependent plasticity with intrinsic noise.
February 29, 2012, Filed Under: PublicationsMultiresolution Hilbert Approach to Multidimensional Gauss-Markov Processes Citation: Taillefumier T, Touboul J. Multiresolution Hilbert Approach to Multidimensional Gauss-Markov Processes. International Journal of Stochastic Analysis [Internet]. 2011 :89. Publisher’s Version Abstract The study of the multidimensional stochastic processes involves complex computations in intricate functional spaces. In particular, the diffusion processes, which include the practically important Gauss-Markov processes, are ordinarily defined through the theory of stochastic integration. Here, inspired by the Lévy-Ciesielski construction of the Wiener process, we propose an alternative representation of multidimensional Gauss-Markov processes as expansions on well-chosen Schauder bases, with independent random coefficients of normal law with zero mean and unit variance. We thereby offer a natural multiresolution description of the Gauss-Markov processes as limits of finite-dimensional partial sums of the expansion, that are strongly almost-surely convergent. Moreover, such finite-dimensional random processes constitute an optimal approximation of the process, in the sense of minimizing the associated Dirichlet energy under interpolating constraints. This approach allows for a simpler treatment of problems in many applied and theoretical fields, and we provide a short overview of applications we are currently developing.
August 11, 2010, Filed Under: PublicationsA Fast Algorithm for the First-Passage Times of Gauss-Markov Processes with Hölder Continuous Boundaries Citation: Taillefumier T, Magnasco MO. A Fast Algorithm for the First-Passage Times of Gauss-Markov Processes with Hölder Continuous Boundaries. Journal of Statistical Physics [Internet]. 140 (6) :1130 – 1156. Publisher’ Version Abstract Even for simple diffusion processes, treating first-passage problems analytically proves intractable for generic barriers and existing numerical methods are inaccurate and computationally costly. Here, we present a novel numerical method that is faster and has more tightly controlled accuracy. Our algorithm is a probabilistic variant of dichotomic search for the computation of first passage times through non-negative homogeneously Hölder continuous boundaries by Gauss-Markov processes. These include the Ornstein-Uhlenbeck process underlying the ubiquitous “leaky integrate-and-fire” model of neuronal excitation. Our method evaluates discrete points in a sample path exactly, and refines this representation recursively only in regions where a passage is rigorously estimated to be probable (e.g. when close to the boundary).
April 25, 2008, Filed Under: PublicationsA Haar-like Construction for the Ornstein Uhlenbeck Process Citation: Taillefumier T, Magnasco MO. A Haar-like Construction for the Ornstein Uhlenbeck Process. Journal of Statistical Physics [Internet]. 132 (2) :397 – 415. Publisher’s Version Abstract The classical Haar construction of Brownian motion uses a binary tree of triangular wedge-shaped functions. This basis has compactness properties which make it especially suited for certain classes of numerical algorithms. We present a similar basis for the Ornstein-Uhlenbeck process, in which the basis elements approach asymptotically the Haar functions as the index increases, and preserve the following properties of the Haar basis: all basis elements have compact support on an open interval with dyadic rational endpoints; these intervals are nested and become smaller for larger indices of the basis element, and for any dyadic rational, only a finite number of basis elements is nonzero at that number. Thus the expansion in our basis, when evaluated at a dyadic rational, terminates in a finite number of steps. We prove the covariance formulae for our expansion and discuss its statistical interpretation.