Hippocampal replay
{{short description|Phenomenon observed in several animals}}
Hippocampal replay is a phenomenon observed in rats, mice,{{cite journal | vauthors = Buhry L, Azizi AH, Cheng S | title = Reactivation, replay, and preplay: how it might all fit together | journal = Neural Plasticity | volume = 2011 | pages = 1–11 | year = 2011 | pmid = 21918724 | pmc = 3171894 | doi = 10.1155/2011/203462 | doi-access = free }} cats, rabbits,{{cite journal | vauthors = Nokia MS, Penttonen M, Wikgren J | title = Hippocampal ripple-contingent training accelerates trace eyeblink conditioning and retards extinction in rabbits | journal = The Journal of Neuroscience | volume = 30 | issue = 34 | pages = 11486–92 | date = August 2010 | pmid = 20739570 | pmc = 6633352 | doi = 10.1523/JNEUROSCI.2165-10.2010 }} songbirds{{cite journal | vauthors = Dave AS, Margoliash D | title = Song replay during sleep and computational rules for sensorimotor vocal learning | journal = Science | volume = 290 | issue = 5492 | pages = 812–6 | date = October 2000 | pmid = 11052946 | doi = 10.1126/science.290.5492.812 | bibcode = 2000Sci...290..812D }} and monkeys.{{cite journal | vauthors = Skaggs WE, McNaughton BL, Permenter M, Archibeque M, Vogt J, Amaral DG, Barnes CA | title = EEG sharp waves and sparse ensemble unit activity in the macaque hippocampus | journal = Journal of Neurophysiology | volume = 98 | issue = 2 | pages = 898–910 | date = August 2007 | pmid = 17522177 | doi = 10.1152/jn.00401.2007 }}
During sleep or awake rest, replay refers to the re-occurrence of a sequence of cell activations that also occurred during activity, but the replay has a much faster time scale. It may be in the same order, or in reverse. Cases were also found where a sequence of activations occurs before the actual activity, but it is still the same sequence. This is called preplay.
The phenomenon has mostly been observed in the hippocampus, a brain region associated with memory and spacial navigation. Specifically, the cells that exhibit this behavior are place cells, characterized by reliably increasing their activity when the animal is in a certain location in space. During navigation, the place cells fire in a sequence according to the path of the animal. In a replay instance, the cells are activated as if in response to the same spatial path, but at a much faster rate than the animal actually moved in.
Background
Place cell activity was already well established when the first study explored this phenomenon in 1989.{{cite journal | vauthors = Pavlides C, Winson J | title = Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes | journal = The Journal of Neuroscience | volume = 9 | issue = 8 | pages = 2907–18 | date = August 1989 | pmid = 2769370 | pmc = 6569689 | doi = 10.1523/JNEUROSCI.09-08-02907.1989 }} They showed that neural activity of single place cells during sleep resembled the activity during the awake state. This activity was greater than that of other cells and this study was only the first step towards understanding replay. Subsequent studies showed that large groups of cells also demonstrated this type of increased activity during sleep. In addition, it was discovered that the order of activity of place cells was also replicated during sleep.{{cite journal | vauthors = Skaggs WE, McNaughton BL | title = Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience | journal = Science | volume = 271 | issue = 5257 | pages = 1870–3 | date = March 1996 | pmid = 8596957 | doi = 10.1126/science.271.5257.1870 | bibcode = 1996Sci...271.1870S | s2cid = 23694471 }} Firing sequences of three and more neurons observed in the hippocampus during locomotion were shown to recur selectively during subsequent slow-wave sleep more likely than during the preceding sleep, and the sequence replay was compressed during high frequency oscillations.{{cite journal | vauthors = Nádasdy Z, Hirase H, Czurkó A, Csicsvari J, Buzsáki G | title = Replay and time compression of recurring spike sequences in the hippocampus | journal = The Journal of Neuroscience | volume = 19 | issue = 21 | pages = 9497–507 | date = November 1999 | pmid = 10531452 | pmc = 6782894 | doi = 10.1523/JNEUROSCI.19-21-09497.1999 }} These high frequency field oscillations called ripples were observed in the sleep state and later shown to play a causal role in memory consolidation.{{cite journal | vauthors = Eschenko O, Ramadan W, Mölle M, Born J, Sara SJ | title = Sustained increase in hippocampal sharp-wave ripple activity during slow-wave sleep after learning | journal = Learning & Memory | volume = 15 | issue = 4 | pages = 222–8 | date = April 2008 | pmid = 18385477 | pmc = 2327264 | doi = 10.1101/lm.726008 }}{{cite journal | vauthors = Girardeau G, Benchenane K, Wiener SI, Buzsáki G, Zugaro MB | title = Selective suppression of hippocampal ripples impairs spatial memory | journal = Nature Neuroscience | volume = 12 | issue = 10 | pages = 1222–3 | date = October 2009 | pmid = 19749750 | doi = 10.1038/nn.2384 | s2cid = 23637142 }}
The next step was the discovery of replay during the awake state. In 1999, ten years after the initial discovery, neural recordings in the awake state were also shown to have replay activity.{{cite journal | vauthors = Kudrimoti HS, Barnes CA, McNaughton BL | title = Reactivation of hippocampal cell assemblies: effects of behavioral state, experience, and EEG dynamics | journal = The Journal of Neuroscience | volume = 19 | issue = 10 | pages = 4090–101 | date = May 1999 | pmid = 10234037 | pmc = 6782694 | doi = 10.1523/JNEUROSCI.19-10-04090.1999 }} It is considerably more difficult to detect this activity in the awake state and several methods including Bayesian decoding have been used to quantify replay events that occur during short wave ripples.{{cite journal | vauthors = Davidson TJ, Kloosterman F, Wilson MA | title = Hippocampal replay of extended experience | journal = Neuron | volume = 63 | issue = 4 | pages = 497–507 | date = August 2009 | pmid = 19709631 | pmc = 4364032 | doi = 10.1016/j.neuron.2009.07.027 }} Recent advances include finding that replay can occur in reverse{{cite journal | vauthors = Karlsson MP, Frank LM | title = Awake replay of remote experiences in the hippocampus | journal = Nature Neuroscience | volume = 12 | issue = 7 | pages = 913–8 | date = July 2009 | pmid = 19525943 | pmc = 2750914 | doi = 10.1038/nn.2344 }} and that it has also been found to occur in different environments.{{cite journal | vauthors = Carr MF, Jadhav SP, Frank LM | title = Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval | journal = Nature Neuroscience | volume = 14 | issue = 2 | pages = 147–53 | date = February 2011 | pmid = 21270783 | pmc = 3215304 | doi = 10.1038/nn.2732 }} The role of replay in memory consolidation in these different conditions and environments is still being explored and several theories attempt to answer this question.
Location and behavioral state
Replay can occur in several different behavioral, physiological, and environmental conditions. The first distinction between awake and sleep states may represent different roles in memory consolidation. In the sleep state, the ripple events and place cell activity similar to that of the activity in the environment define the replay events. In the sleep state, there is also a distinction between REM (rapid eye movement) and SWS (slow wave sleep) which has implications for replay events.{{cite journal | vauthors = Louie K, Wilson MA | title = Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep | journal = Neuron | volume = 29 | issue = 1 | pages = 145–56 | date = January 2001 | pmid = 11182087 | doi = 10.1016/S0896-6273(01)00186-6 | doi-access = free }}{{cite journal | vauthors = Lee AK, Wilson MA | title = Memory of sequential experience in the hippocampus during slow wave sleep | journal = Neuron | volume = 36 | issue = 6 | pages = 1183–94 | date = December 2002 | pmid = 12495631 | doi = 10.1016/s0896-6273(02)01096-6 | doi-access = free }} During SWS the place cells fire in a sequential order indicating replay and possibly indicate memory consolidation. However, during REM sleep where dreams occur in humans, replay events also occurred suggesting a possible role for place cells in dreams.
In the awake state the same activity occurs, however it is more difficult to detect and the animal must be in a resting state. Lastly, there are many environments for replay events in the awake animal. The length of the track can be short or long and still be replayed by a population of place cells.{{cite journal | vauthors = Davidson TJ, Kloosterman F, Wilson MA | title = Hippocampal replay of extended experience | journal = Neuron | volume = 63 | issue = 4 | pages = 497–507 | date = August 2009 | pmid = 19709631 | pmc = 4364032 | doi = 10.1016/j.neuron.2009.07.027 }} In addition, replay of a single environment can occur when the animal is in that environment or in different environments.{{cite journal | vauthors = Diba K, Buzsáki G | title = Forward and reverse hippocampal place-cell sequences during ripples | journal = Nature Neuroscience | volume = 10 | issue = 10 | pages = 1241–2 | date = October 2007 | pmid = 17828259 | pmc = 2039924 | doi = 10.1038/nn1961 }}{{cite journal | vauthors = Karlsson MP, Frank LM | title = Awake replay of remote experiences in the hippocampus | journal = Nature Neuroscience | volume = 12 | issue = 7 | pages = 913–8 | date = July 2009 | pmid = 19525943 | pmc = 2750914 | doi = 10.1038/nn.2344 }} This may show that consolidation of memory is a persistent process that may occur in several different types of environments and behavioral conditions. The robustness of the replay events indicates the importance of this process.
Preplay
As mentioned above, the sequential activation of hippocampal place cells according to their place fields may occur during rest periods before the animal is actually traversing the activated path, even if the animal has never experienced it before.{{cite journal | vauthors = Dragoi G, Tonegawa S | title = Preplay of future place cell sequences by hippocampal cellular assemblies | journal = Nature | volume = 469 | issue = 7330 | pages = 397–401 | date = January 2011 | pmid = 21179088 | pmc = 3104398 | doi = 10.1038/nature09633 | bibcode = 2011Natur.469..397D }} This suggests that hippocampal activation during rest may have a function not only in memory consolidation and retrieval, but also in planning: it contributes to the organization of the network for improving the encoding of future events.
Sensory cue for activation
Sensory stimuli can induce replay events or enhance the replay:{{cite journal | vauthors = Carr MF, Jadhav SP, Frank LM | title = Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval | journal = Nature Neuroscience | volume = 14 | issue = 2 | pages = 147–53 | date = February 2011 | pmid = 21270783 | pmc = 3215304 | doi = 10.1038/nn.2732 }} in the awake state, replay often begins from the current location and continue either forward or backward in time, and nearby locations are more likely to be the place fields of neurons exhibiting replay than far away locations. This is like cued memory retrieval, where a sensory input triggers retrieval of similar or relevant memories. The cue may even trigger a replay in a different environment, if the place cells cued represent a location in a different environment in addition to the current location of the animal.
Interaction with cortex
Several studies are beginning to understand that replay may not only occur in the hippocampus. Replay has been linked to coherent activity in cortical regions of the default mode network.{{cite journal | vauthors = Higgins C, Liu Y, Vidaurre D, Kurth-Nelson Z, Dolan R, Behrens T, Woolrich M | title = Replay bursts in humans coincide with activation of the default mode and parietal alpha networks | journal = Neuron | volume = 109 | pages = 882–893 | date = March 2021 | issue = 5 | doi = 10.1016/j.neuron.2020.12.007 | doi-access = free | pmid = 33357412 | pmc = 7927915 | url = https://pure.au.dk/ws/files/274248205/1_s2.0_S0896627320309661_main.pdf }} After learning, similar replay events occurred in both the thalamus and cortex.{{cite journal | vauthors = Ribeiro S, Gervasoni D, Soares ES, Zhou Y, Lin SC, Pantoja J, Lavine M, Nicolelis MA | title = Long-lasting novelty-induced neuronal reverberation during slow-wave sleep in multiple forebrain areas | journal = PLOS Biology | volume = 2 | issue = 1 | pages = E24 | date = January 2004 | pmid = 14737198 | pmc = 314474 | doi = 10.1371/journal.pbio.0020024 | doi-access = free }} In addition, the visual cortex showed population activity that was both coordinated into discrete time regions and that it occurred simultaneously with activity in the hippocampus.{{cite journal | vauthors = Ji D, Wilson MA | title = Coordinated memory replay in the visual cortex and hippocampus during sleep | journal = Nature Neuroscience | volume = 10 | issue = 1 | pages = 100–7 | date = January 2007 | pmid = 17173043 | doi = 10.1038/nn1825 | s2cid = 205431067 }} Concurrent re-activation in the hippocampus and cortex may demonstrate that memory consolidation requires cortical input/output to maintain a memory. This hypothesis fits well with the idea that the cortex plays an integral role in memory retrieval after consolidation occurs. Therefore, hippocampal replay may play the role of information transfer between the hippocampus and cortex, yet this idea requires further verification.
Function in memory
Hippocampal replay in the awake state has been implicated, though not demonstrated, to correlate with performance in navigation tasks after the replay event.{{cite journal | vauthors = Carr MF, Jadhav SP, Frank LM | title = Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval | journal = Nature Neuroscience | volume = 14 | issue = 2 | pages = 147–53 | date = February 2011 | pmid = 21270783 | pmc = 3215304 | doi = 10.1038/nn.2732 }} Replay may play a role in consolidation of memories related to spatial location,{{cite journal | vauthors = Derdikman D, Moser MB | title = A dual role for hippocampal replay | journal = Neuron | volume = 65 | issue = 5 | pages = 582–4 | date = March 2010 | pmid = 20223195 | doi = 10.1016/j.neuron.2010.02.022 | doi-access = free }} although a clear causal relationship between replay and memory consolidation is still unproven. Furthermore, replay also seems to be related to memory retrieval: it is activated by cues that also trigger memory retrieval, and in situations that require it, such as planning a trajectory based on the consequences of past choices. This relationship is also still only correlative, but there are studies showing evidence for the necessity of replay in successful memory retrieval.{{cite journal | vauthors = Dupret D, O'Neill J, Pleydell-Bouverie B, Csicsvari J | title = The reorganization and reactivation of hippocampal maps predict spatial memory performance | journal = Nature Neuroscience | volume = 13 | issue = 8 | pages = 995–1002 | date = August 2010 | pmid = 20639874 | pmc = 2923061 | doi = 10.1038/nn.2599 }}
Replay is likely to participate in both the consolidation of memories and in building a cognitive map. Replay is also likely to play an important role in generating and maintaining a value map, which is a proposed variation of cognitive map in which memories are reinforced according to their values. {{cite journal | vauthors = Bhattarai B, Lee JW, Jung MW | title = Distinct effects of reward and navigation history on hippocampal forward and reverse replays | journal = Proceedings of the National Academy of Sciences of the United States of America | volume = 117 | issue = 1 | pages = 689–697 | date = December 23, 2019 | pmid = 31871185 | pmc = 6955321 | doi = 10.1073/pnas.1912533117 | doi-access = free }}
In studies done to monitor the patterns of the hippocampal replay of events happening in the minds of the rats, it was discovered that they rely heavily on long term re-playable memories for their daily lives. To determine if the animals could really retain the memories scientists set up a series of episodic events (i.e. a series of tunnels, a maze, a track full of twists and turns) to visualize the neuron activity as the rat completes its round around the new surroundings. The chemogenetic activating drug clozapine N-oxide (CNO), but not vehicle, reversibly impairs episodic memory replay in rats previously injected bilaterally in the hippocampus with a recombinant viral vector containing an inhibitory designer receptor exclusively activated by a designer drug (DREADD; AAV8-hSyn-hM4Di-mCherry). By contrast, two non-episodic memory assessments are unaffected by CNO, showing selectivity of this hippocampal-dependent impairment.{{cite journal | vauthors = Panoz-Brown D, Iyer V, Carey LM, Sluka CM, Rajic G, Kestenman J, Gentry M, Brotheridge S, Somekh I, Corbin HE, Tucker KG, Almeida B, Hex SB, Garcia KD, Hohmann AG, Crystal JD | title = Replay of Episodic Memories in the Rat | journal = Current Biology | volume = 28 | issue = 10 | pages = 1628–1634.e7 | date = May 2018 | pmid = 29754898 | pmc = 5964044 | doi = 10.1016/j.cub.2018.04.006 }}