Would the field of cognitive neuroscience be advanced by sharing functional MRI data?
© Visscher and Weissman; licensee BioMed Central Ltd. 2011
Received: 21 December 2010
Accepted: 8 April 2011
Published: 8 April 2011
During the past two decades, the advent of functional magnetic resonance imaging (fMRI) has fundamentally changed our understanding of brain-behavior relationships. However, the data from any one study add only incrementally to the big picture. This fact raises important questions about the dominant practice of performing studies in isolation. To what extent are the findings from any single study reproducible? Are researchers who lack the resources to conduct a fMRI study being needlessly excluded? Is pre-existing fMRI data being used effectively to train new students in the field? Here, we will argue that greater sharing and synthesis of raw fMRI data among researchers would make the answers to all of these questions more favorable to scientific discovery than they are today and that such sharing is an important next step for advancing the field of cognitive neuroscience.
What is functional MRI?
Functional MRI is a non-invasive technique for determining the neural correlates of mental processes in humans and other animals. During the past two decades, this technique has become a leading method in the field of cognitive neuroscience that has brought about revolutionary changes in our understanding of brain-behavior relationships [reviewed, e.g., in ]. Nevertheless, functional MRI studies yield tremendous quantities of multidimensional data and are expensive to conduct. This raises the question of whether greater sharing of fMRI data would allow the field to get more 'bang for its buck' from each data set.
Potential benefits of sharing fMRI data
What if the raw anatomical and functional images from every published fMRI study were freely available online? In our view, such a scenario would benefit the field of cognitive neuroscience in numerous ways [see also [2, 3]]. First, it would allow researchers to quickly establish the reproducibility of a new finding and to test hypotheses using much larger data sets. Second, it would allow researchers with complementary expertise to provide multiple characterizations of the same data. Third, it would enhance the training of new cognitive neuroscientists.
Quickly establishing the reproducibility of a finding
Replication is important in every scientific discipline for showing that an effect is real (that is, it is not an artifact of a particular procedure or analysis). If data sharing were more prevalent, then it would often be possible to quickly determine whether a new finding is reproducible. For example, one could re-analyze similar data from multiple laboratories to determine whether, and under what conditions, the effect is present. This would speed the community's ability to assess the significance of a new finding and, if warranted, plan future studies. For instance, it might speed the community's ability to assess whether a new finding is relevant to treating a neurological disorder - a top priority of various funding agencies (for example, the United States National Institutes of Health). In the absence of extensive data sharing, researchers sometimes reanalyze multiple data sets from their own laboratories [e.g., ]: a useful but more limited approach.
Allowing multiple researchers with complementary expertise to characterize the same data
The field of cognitive neuroscience is becoming increasingly specialized. Both the nature of processes being investigated (for example, cognitive, affective, social, cultural, and so on) and the types of fMRI methods used to identify the neural mechanisms underlying these processes (for example, blocked designs, event-related designs, mixed designs, functional connectivity, effective connectivity, pattern classification, and so on) have exploded in the past ten years. Given such specialization, any single researcher is unlikely to know all of the hypotheses (and methods) that could be tested (and employed) in a particular study. Greater sharing of fMRI data could thus allow more hypotheses to be tested with a given data set, a desirable outcome given the high cost of obtaining fMRI scans from each study participant (typically hundreds of dollars per hour).
Data sharing could also promote synergistic activities between researchers that would not otherwise occur. Two cognitive neuroscientists with complementary methodological expertise (for example, functional connectivity and pattern classification techniques) might work together to characterize the relationship between distinct neural measures of a particular cognitive process (for example, attention). Additionally, cognitive neuroscientists might benefit more extensively from analytic techniques developed in other fields (for example, engineering or mathematics) that enable entirely new classes of hypotheses to be tested. The application of pattern classification methods to fMRI data is a timely example of how a transplanted mathematical technique has greatly influenced cognitive neuroscience research . If data sharing were more prevalent, then it would be easier for scientists in other fields to develop new methods for analyzing fMRI data. This could speed the rate at which those methods enable new discoveries in cognitive neuroscience (Text Box).
More extensive data sharing would also aid researchers who do not have the resources to conduct their own fMRI studies. A shortage of resources might arise from a lack of access or expertise with regard to special populations. For example, studies of clinical disorders are often harder to conduct than studies of healthy controls because they require expertise related to recruiting, diagnosing, and interacting with patients. A dearth of resources could also arise from a temporary lack of funding. Indeed, the percentage of grant applications funded by the National Institutes of Health (NIH) and the National Science Foundation (NSF) varies dramatically with the size of the federal budget. When funding percentages are low, greater data sharing would facilitate the ability of talented researchers to continue investigating intriguing brain-behavior relationships.
Influential government organizations also see the value of data sharing. The Organization for Economic Co-operation and Development, which includes officials from 30 democracies across the globe, states that 'access to research data increases the returns from public investment in this area; reinforces open scientific inquiry; encourages diversity of studies and opinion; promotes new areas of work and enables the exploration of topics not envisioned by the initial investigators' . Similarly, the NIH, a major funding agency in the United States, views data sharing as 'essential for expedited translation of research results into knowledge, products, and procedures to improve human health' . In short, there is a widespread perception that data sharing can advance science by allowing researchers with complementary expertise to characterize the same data. Nonetheless, data sharing is not yet standard practice in many fields , including cognitive neuroscience.
Enhancing the training of new cognitive neuroscientists
Training new students in fMRI methodology is crucial to the future of cognitive neuroscience. Given that numerous methods exist for analyzing fMRI data (see above), such training would ideally involve reanalyzing publicly available data sets that map onto published studies in the literature. By comparing the results of their re-analyses to the published data, new students could check whether they are performing the analyses correctly. More fundamentally, they would learn how various methods give rise to different findings in the literature. Such training is especially important given that many students find themselves in laboratories that use a restricted range of fMRI methods.
These intuitions about the usefulness of publicly available data sets are borne out by experience. For example, DHW uses a publicly available data set to teach event-related fMRI regression analyses in a functional MRI methods course . At present, however, publicly available data sets do not cover the full range of analyses that are reported in the literature. Thus, greater data sharing would facilitate educators' ability to teach an even wider variety of fMRI analyses.
Potential pitfalls of sharing fMRI data
Given that data sharing has so many potential benefits, why is it not more prevalent? There are likely many reasons. First, researchers may dread the time needed to organize data from an fMRI study into a standardized format and transfer it to an online repository. Second, they may wonder whether subject confidentiality can be maintained. Third, they may be concerned that other researchers could reanalyze their data and publish important results before they can (for example, from a data set that is expected to yield multiple papers). Fourth, they may worry about the results of a reanalysis suggesting that a previously published finding is inaccurate, whether or not that is truly the case. In short, despite the potential benefits of data sharing, outlined above, there are many reasons why researchers may choose not to share their fMRI data . We now discuss these potential barriers to sharing fMRI data and suggest some ways to overcome them.
Organizing and depositing data in an online repository and maintaining subject confidentiality
Some of these issues may not be too difficult to address. First, researchers already have an incentive to archive their data sets in a standardized format, if only to ensure that they can readily access their own data at some later time. Thus, if a universal standard could be agreed upon, and was not overly time-consuming to implement, then researchers would be more likely to adopt it. Discussions concerning the nature of such a standard format for raw data are ongoing in conference proceedings [for example [11, 12]], and in online forums such as the 'Neuroimaging Data Access Group' (http://www.nidag.org/) and the 'International Neuroinformatics Coordinating Facility' (http://www.incf.org/). Updating popular fMRI analysis packages with programs that archive data in a standard format could facilitate the community's transition by decreasing the time required to move data to a standardized format. Second, the difficulties associated with placing archived data into an online repository might be eased with user friendly, high speed interfaces that make data organization and/or transfer less tedious. Third, it is possible to de-identify functional and anatomical scans to maintain subject confidentiality [e.g., ]. For these reasons, such issues are unlikely to form insurmountable barriers to data sharing.
Two efforts to develop a standard ontology for describing cognitive neuroscience data
Neuroscience Information Framework
A dynamic inventory of web-based neuroscience resources. One goal is to develop and maintain a comprehensive vocabulary for annotating and searching neuroscience resources
Cognitive Paradigm Ontology Project
This project specifically targets the competitive terminologies within cognitive neuroscience research.
Worries that a reanalysis might 'scoop' an important result could be addressed in two ways. First, the researchers who collected the data could, as a standard practice, be offered the opportunity to collaborate on one or more projects that were made possible by sharing the data. This policy would allow the original investigators to be authors on publications resulting from subsequent analyses of their data. In the 'publish or perish' climate that characterizes academic research, this practice could go a long way towards assuaging the fear that sharing fMRI data would translate into fewer publications. Second, researchers could opt to share their data only after they had published their primary findings. These policies would maximize the number of publicly available fMRI data sets while minimizing worries about being scooped.
Worries that a reanalysis might contradict published findings may also influence a researcher's decision to share (or not share) fMRI data. In some cases, such a contradiction might stem from a different method of analysis, in which case it could be highly informative about the phenomenon under investigation. For example, conclusions about the role of visual area V1 in working memory differ depending on whether activity or pattern classification is the dependent measure . In other cases, such a contradiction might result from a genuine error in the original analysis. Nonetheless, reporting such errors would help to ensure that they do not influence the design and analysis of future studies and would likely help the original researchers to avoid similar mistakes in future studies. Thus, reporting discrepancies that are revealed by reanalyzing published data would benefit the cognitive neuroscience community.
Tools for data sharing
Despite the potential pitfalls associated with sharing fMRI data, some cognitive neuroscientists have already made their data available to the public in various online repositories. Although this practice is quite limited, it is beginning to allow the field to realize some of the potential benefits of more extensive data sharing. We now review these online repositories and provide examples of how they are advancing the field of cognitive neuroscience.
Repositories for sharing raw fMRI data
These repositories typically include the raw functional and structural images from a study along with meta-data that describes essential aspects of the study. Such meta-data typically include information about how the MRI images were collected, a description of the tasks that were performed by participants, the onset times for different conditions in those tasks, any behavioral data that were recorded, and demographic information about each participant. Armed with this information, researchers can reproduce the published findings or test new hypotheses that were not addressed by the original researchers.
Some online repositories for raw MRI data
Anatomical images across the lifespan
Functional MRI Data Center
Data from task-based fMRI studies (this respository no longer accepts new data sets)
Open fMRI Project
Data from task-based fMRI studies (this repository currently has only a few data sets)
1000 Functional Connectomes Project
Data from over 1,400 resting-state functional connectivity data studies are available
We now provide three brief examples to illustrate how sharing raw fMRI data can advance cognitive neuroscience research. First, on a small scale, DHW and colleagues reanalyzed fMRI data from a previous study of the multisource interference task  and found that increased reaction time could account for heightened medial prefrontal cortex activity associated with response conflict . This result suggests that any of several processes whose recruitment increases with reaction time (for example, attention, arousal, or effort) might explain such activity and thus raises doubt about the popular claim that such activity is specific to processes that detect response conflict . Second, on a larger scale, a meta-analysis of the hundreds of datasets made available by the 1,000 Functional Connectomes Project revealed that resting-state functional connectivity varies with age, sex, and imaging center . Given that such connectivity often distinguishes patients from healthy controls [reviewed in ], further developing our understanding of the variables that influence it may be crucial for interpreting the results of clinical studies. More broadly, such 'mega-analyses' involving hundreds of data sets may provide increased statistical power for revealing the neural substrates of numerous important individual differences. Third, an analysis of 972 data sets from this same repository was recently used to develop a new type of functional connectivity analysis . While by no means exhaustive, these examples illustrate the vast potential of sharing and synthesizing fMRI data to advance the field of cognitive neuroscience.
Online repositories for sharing processed fMRI data
Repositories of processed fMRI data typically include the peak coordinates (in standardized space) from one or more statistical maps [http://brainmap.org, [22, 23]] or sometimes the whole-brain statistical maps themselves [http://sumsdb.wustl.edu/sums, [24, 25]]. Each set of coordinates or statistical map is tagged with information about which data analyses were conducted to produce it. Moreover, the data are labeled by the original researchers with the keywords (and ontologies) that are standard to a given databank. This allows other investigators to readily find and retrieve the data from the online repository .
Working with processed data allows researchers to quickly combine the results from several datasets [26–29]. Such amalgamations can then be used in meta-analyses to assess the reproducibility of an effect or to determine whether the results of a given study generalize to other paradigms [e.g., [30, 31]]. Meta-analyses in which researchers provide peak coordinates from prior experiments are one way to share processed fMRI data [e.g., [32–34]]. However, using searchable databases in combination with statistical methods for aggregating data across studies allows a larger number of datasets to be included in a meta-analysis . Perhaps for this reason, the number of meta-analyses involving searchable databases has grown steadily during the last few years [3, 27, 29].
Findings from meta-analyses of processed fMRI data can be quite informative. For example, one recent study showed that regions of a so-called 'default-mode network' whose activity is correlated at rest also display correlated activity during task performance . Further, the results suggested regional specialization of function in various regions of the default-mode network. This study provides a simple example of how combining processed fMRI data from a wide range of tasks and subjects, which can be gleaned from an online repository (in this case, the Brainmap database http://www.brainmap.org), can advance the field of cognitive neuroscience.
Raw data versus processed data
Raw and processed data offer complementary strengths and weaknesses. Raw data permit a researcher to test a wider range of novel hypotheses, but take time to analyze. Processed data allow a researcher to quickly compare the results of numerous studies, but offer less flexibility with regard to testing new hypotheses. Thus, a researcher's choice about whether to use raw or processed data should probably be made while considering the goals of the study.
If a researcher chooses to reanalyze processed fMRI data, then he or she should be aware of several factors that might limit the conclusions that can be drawn. As an illustration, consider a hypothetical meta-analysis of medial prefrontal cortex activity across 50 studies. Differences in the location of such activity could be due to the factors of interest that distinguish the studies (for example, the tasks performed, the subjects involved, and so on). On the other hand, they could be due to differences in the analyses and/or statistical thresholds that different researchers employed. In short, although processed fMRI data are preferable to raw fMRI data in some situations (for example, a meta-analysis), they sometimes limit the conclusions that researchers can draw.
Analogous to data sharing in other fields, sharing fMRI data offers many potential advantages to the field of cognitive neuroscience. These include quickly establishing the reproducibility of a new finding, allowing researchers with complementary expertise to provide multiple characterizations of the same data, and enhancing the training of new students. Although there are some potential drawbacks, we feel that many of these can be ameliorated through continued discussion and development of consensus in the cognitive neuroscience community. Thus, we conclude that the field should strive to overcome these potential pitfalls so that it can grow to fully realize the benefits of sharing fMRI data.
Text box: The 'discovery' of pattern classification techniques
In recent years, pattern classification techniques for analyzing fMRI data have greatly influenced cognitive neuroscience research. These techniques enable researchers to determine whether the spatial distribution, or pattern, of activity varies for different conditions or stimuli, consistent with the idea that information is distributed in the brain . They also provide greater sensitivity for identifying differences in activity between two conditions than does contrasting activity for those conditions in isolated regions .
As mentioned above, pattern classification techniques were applied to fMRI data only after cognitive neuroscientists realized they were useful in other fields. By allowing researchers with different areas of expertise to work directly with raw fMRI data, greater data sharing would distribute the process of developing and testing new analytic methods across a much wider variety of individuals and laboratories. Such a distribution could more quickly reveal which methods from other fields are likely to be useful, thereby increasing the rate at which new discoveries are made in cognitive neuroscience.
- Jonides J, Nee DE, Berman MG: What has functional neuroimaging told us about the mind? So many examples, so little space. Cortex. 2006, 42: 414-417. 10.1016/S0010-9452(08)70372-1. discussion 422-427View ArticlePubMedGoogle Scholar
- Van Horn JD, Toga AW: Is it time to re-prioritize neuroimaging databases and digital repositories?. Neuroimage. 2009, 47: 1720-1734. 10.1016/j.neuroimage.2009.03.086.View ArticlePubMedPubMed CentralGoogle Scholar
- Yarkoni T, Poldrack RA, Van Essen DC, Wager TD: Cognitive neuroscience 2.0: building a cumulative science of human brain function. Trends in Cognitive Sciences. 2010, 14: 489-496. 10.1016/j.tics.2010.08.004.View ArticlePubMedPubMed CentralGoogle Scholar
- Yarkoni T, Barch DM, Gray JR, Conturo TE, Braver TS: BOLD correlates of trial-by-trial reaction time variability in gray and white matter: a multi-study fMRI analysis. PLoS ONE. 2009, 4: e4257-10.1371/journal.pone.0004257.View ArticlePubMedPubMed CentralGoogle Scholar
- Cox DD, Savoy RL: Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage. 2003, 19: 261-270. 10.1016/S1053-8119(03)00049-1.View ArticlePubMedGoogle Scholar
- Organisation for Economic Co-operation and Development: OECD Principles and guidelines for access to research data from public funding. 2007Google Scholar
- National Institutes of Health: Final NIH statement on sharing Research Data. 2003Google Scholar
- Nelson B: Data sharing: Empty archives. Nature. 2009, 461: 160-163. 10.1038/461160a.View ArticlePubMedGoogle Scholar
- Maccotta L, Buckner RL: Evidence for neural effects of repetition that directly correlate with behavioral priming. J Cogn Neurosci. 2004, 16: 1625-1632. 10.1162/0898929042568451.View ArticlePubMedGoogle Scholar
- A debate over fMRI data sharing. Nat. Neurosci. 2000, 3: 845-846. 10.1038/78728.
- Liu Y, Ascoli GA: Value Added by Data Sharing: Long-Term Potentiation of Neuroscience Research. Neuroinform. 2007, 5: 143-145. 10.1007/s12021-007-0009-0.View ArticleGoogle Scholar
- Teeters JL, Harris KD, Millman KJ, Olshausen BA, Sommer FT: Data Sharing for Computational Neuroscience. Neuroinform. 2008, 6: 47-55. 10.1007/s12021-008-9009-y.View ArticleGoogle Scholar
- Bischoff-Grethe A, Ozyurt IB, Busa E, Quinn BT, Fennema-Notestine C, Clark CP, Morris S, Bondi MW, Jernigan TL, Dale AM, Brown GG, Fischl B: A technique for the deidentification of structural brain MR images. Hum. Brain Mapp. 2007, 28: 892-903. 10.1002/hbm.20312.View ArticlePubMedPubMed CentralGoogle Scholar
- Laird AR, Eickhoff SB, Kurth F, Fox PM, Uecker AM, Turner JA, Robinson JL, Lancaster JL, Fox PT: ALE Meta-Analysis Workflows Via the Brainmap Database: Progress Towards A Probabilistic Functional Brain Atlas. Front Neuroinformatics. 2009, 3: 23.View ArticlePubMed CentralGoogle Scholar
- Serences JT, Ester EF, Vogel EK, Awh E: Stimulus-specific delay activity in human primary visual cortex. Psychol Sci. 2009, 20: 207-214. 10.1111/j.1467-9280.2009.02276.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Fitzgerald KD, Stern ER, Angstadt M, Nicholson-Muth KC, Maynor MR, Welsh RC, Hanna GL, Taylor SF: Altered function and connectivity of the medial frontal cortex in pediatric obsessive-compulsive disorder. Biol. Psychiatry. 2010, 68: 1039-1047. 10.1016/j.biopsych.2010.08.018.View ArticlePubMedPubMed CentralGoogle Scholar
- Carp J, Kim K, Taylor S, Fitzgerald K, Weissman D: Conditional differences in mean reaction time explain effects of response congruency, but not accuracy, on posterior medial frontal cortex activity. Frontiers in Human Neuroscience. 2010, 4: 10.3389/fnhum.2010.00217.Google Scholar
- Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD: Conflict monitoring and cognitive control. Psychol Rev. 2001, 108: 624-652. 10.1037/0033-295X.108.3.624.View ArticlePubMedGoogle Scholar
- Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, Smith SM, Beckmann CF, Adelstein JS, Buckner RL, Colcombe S, Dogonowski AM, Ernst M, Fair D, Hampson M, Hoptman MJ, Hyde JS, Kiviniemi VJ, Kötter R, Li SJ, Lin CP, Lowe MJ, Mackay C, Madden DJ, Madsen KH, Margulies DS, Mayberg HS, McMahon K, Monk CS, Mostofsky SH, Nagel BJ, Pekar JJ, Peltier SJ, Petersen SE, Riedl V, Rombouts SARB, Rypma B, Schlaggar BL, Schmidt S, Seidler RD, Siegle GJ, Sorg C, Teng GJ, Veijola J, Villringer A, Walter M, Wang L, Weng XC, Whitfield-Gabrieli S, Williamson P, Windischberger C, Zang YF, Zhang HY, Castellanos FX, Milham MP: Toward discovery science of human brain function. Proc. Natl. Acad. Sci. USA. 2010, 107: 4734-4739. 10.1073/pnas.0911855107.View ArticlePubMedPubMed CentralGoogle Scholar
- Greicius M: Resting-state functional connectivity in neuropsychiatric disorders. Curr. Opin. Neurol. 2008, 21: 424-430. 10.1097/WCO.0b013e328306f2c5.View ArticlePubMedGoogle Scholar
- Tomasi D, Volkow ND: Ultrafast method for mapping local functional connectivity hubs in the human brain. Conf Proc IEEE Eng Med Biol Soc. 2010, 1: 4274-4277.Google Scholar
- Laird AR, Lancaster JL, Fox PT: BrainMap: the social evolution of a human brain mapping database. Neuroinformatics. 2005, 3: 65-78. 10.1385/NI:3:1:065.View ArticlePubMedGoogle Scholar
- Fox PT, Lancaster JL: Opinion: Mapping context and content: the BrainMap model. Nat. Rev. Neurosci. 2002, 3: 319-321. 10.1038/nrn789.View ArticlePubMedGoogle Scholar
- Dickson J, Drury H, Van Essen DC: "The surface management system" (SuMS) database: a surface-based database to aid cortical surface reconstruction, visualization and analysis. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 2001, 356: 1277-1292. 10.1098/rstb.2001.0913.View ArticlePubMedPubMed CentralGoogle Scholar
- Van Essen DC, Drury HA, Dickson J, Harwell J, Hanlon D, Anderson CH: An integrated software suite for surface-based analyses of cerebral cortex. J Am Med Inform Assoc. 2001, 8: 443-459. 10.1136/jamia.2001.0080443.View ArticlePubMedPubMed CentralGoogle Scholar
- Derrfuss J, Mar RA: Lost in localization: the need for a universal coordinate database. Neuroimage. 2009, 48: 1-7. 10.1016/j.neuroimage.2009.01.053.View ArticlePubMedGoogle Scholar
- Laird AR, Lancaster JL, Fox PT: Lost in localization? The focus is meta-analysis. Neuroimage. 2009, 48: 18-20. 10.1016/j.neuroimage.2009.06.047.View ArticlePubMedPubMed CentralGoogle Scholar
- Nielsen FA: Lost in localization: a solution with neuroinformatics 2.0?. Neuroimage. 2009, 48: 11-13. 10.1016/j.neuroimage.2009.05.073.View ArticlePubMedGoogle Scholar
- Van Essen DC: Lost in localization--but found with foci?!. Neuroimage. 2009, 48: 14-17. 10.1016/j.neuroimage.2009.05.050.View ArticlePubMedPubMed CentralGoogle Scholar
- Smith SM, Fox PT, Miller KL, Glahn DC, Fox PM, Mackay CE, Filippini N, Watkins KE, Toro R, Laird AR, Beckmann CF: Correspondence of the brain's functional architecture during activation and rest. Proceedings of the National Academy of Sciences. 2009, 106: 13040-13045. 10.1073/pnas.0905267106.View ArticleGoogle Scholar
- Laird AR, Eickhoff SB, Li K, Robin DA, Glahn DC, Fox PT: Investigating the functional heterogeneity of the default mode network using coordinate-based meta-analytic modeling. J Neurosci. 2009, 29: 14496-10.1523/JNEUROSCI.4004-09.2009.View ArticlePubMedPubMed CentralGoogle Scholar
- Cabeza R, Nyberg L: Imaging cognition II: An empirical review of 275 PET and fMRI studies. J Cogn Neurosci. 2000, 12: 1-47. 10.1162/08989290051137585.View ArticlePubMedGoogle Scholar
- Chein JM, Fissell K, Jacobs S, Fiez JA: Functional heterogeneity within Broca's area during verbal working memory. Physiol. Behav. 2002, 77: 635-639. 10.1016/S0031-9384(02)00899-5.View ArticlePubMedGoogle Scholar
- Wager TD, Jonides J, Reading S: Neuroimaging studies of shifting attention: a meta-analysis. Neuroimage. 2004, 22: 1679-1693. 10.1016/j.neuroimage.2004.03.052.View ArticlePubMedGoogle Scholar
- Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P: Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science. 2001, 293: 2425-2430. 10.1126/science.1063736.View ArticlePubMedGoogle Scholar
- Norman KA, Polyn SM, Detre GJ, Haxby JV: Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. (Regul. Ed.). 2006, 10: 424-430. 10.1016/j.tics.2006.07.005.View ArticleGoogle Scholar
- Brown MPS, Grundy WN, Lin D, Cristianini N, Sugnet CW, Furey TS, Ares M, Haussler D: Knowledge-based analysis of microarray gene expression data by using support vector machines. Proceedings of the National Academy of Sciences of the United States of America. 2000, 97: 262-267. 10.1073/pnas.97.1.262.View ArticlePubMedPubMed CentralGoogle Scholar
- Haynes JD, Rees G: Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci. 2005, 8: 686-691. 10.1038/nn1445.View ArticlePubMedGoogle Scholar
- Kamitani Y, Tong F: Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005, 8: 679-685. 10.1038/nn1444.View ArticlePubMedPubMed CentralGoogle Scholar
- Serences JT: Value-based modulations in human visual cortex. Neuron. 2008, 60: 1169-81. 10.1016/j.neuron.2008.10.051.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/9/34/prepub