Sat Dec 14 11:59:02 2024
EVENTS
 FREE
SOFTWARE
INSTITUTE

POLITICS
JOBS
MEMBERS'
CORNER

MAILING
LIST

NYLXS Mailing Lists and Archives
NYLXS Members have a lot to say and share but we don't keep many secrets. Join the Hangout Mailing List and say your peice.

DATE 2017-06-01

HANGOUT

2024-12-14 | 2024-11-14 | 2024-10-14 | 2024-09-14 | 2024-08-14 | 2024-07-14 | 2024-06-14 | 2024-05-14 | 2024-04-14 | 2024-03-14 | 2024-02-14 | 2024-01-14 | 2023-12-14 | 2023-11-14 | 2023-10-14 | 2023-09-14 | 2023-08-14 | 2023-07-14 | 2023-06-14 | 2023-05-14 | 2023-04-14 | 2023-03-14 | 2023-02-14 | 2023-01-14 | 2022-12-14 | 2022-11-14 | 2022-10-14 | 2022-09-14 | 2022-08-14 | 2022-07-14 | 2022-06-14 | 2022-05-14 | 2022-04-14 | 2022-03-14 | 2022-02-14 | 2022-01-14 | 2021-12-14 | 2021-11-14 | 2021-10-14 | 2021-09-14 | 2021-08-14 | 2021-07-14 | 2021-06-14 | 2021-05-14 | 2021-04-14 | 2021-03-14 | 2021-02-14 | 2021-01-14 | 2020-12-14 | 2020-11-14 | 2020-10-14 | 2020-09-14 | 2020-08-14 | 2020-07-14 | 2020-06-14 | 2020-05-14 | 2020-04-14 | 2020-03-14 | 2020-02-14 | 2020-01-14 | 2019-12-14 | 2019-11-14 | 2019-10-14 | 2019-09-14 | 2019-08-14 | 2019-07-14 | 2019-06-14 | 2019-05-14 | 2019-04-14 | 2019-03-14 | 2019-02-14 | 2019-01-14 | 2018-12-14 | 2018-11-14 | 2018-10-14 | 2018-09-14 | 2018-08-14 | 2018-07-14 | 2018-06-14 | 2018-05-14 | 2018-04-14 | 2018-03-14 | 2018-02-14 | 2018-01-14 | 2017-12-14 | 2017-11-14 | 2017-10-14 | 2017-09-14 | 2017-08-14 | 2017-07-14 | 2017-06-14 | 2017-05-14 | 2017-04-14 | 2017-03-14 | 2017-02-14 | 2017-01-14 | 2016-12-14 | 2016-11-14 | 2016-10-14 | 2016-09-14 | 2016-08-14 | 2016-07-14 | 2016-06-14 | 2016-05-14 | 2016-04-14 | 2016-03-14 | 2016-02-14 | 2016-01-14 | 2015-12-14 | 2015-11-14 | 2015-10-14 | 2015-09-14 | 2015-08-14 | 2015-07-14 | 2015-06-14 | 2015-05-14 | 2015-04-14 | 2015-03-14 | 2015-02-14 | 2015-01-14 | 2014-12-14 | 2014-11-14 | 2014-10-14 | 2014-09-14 | 2014-08-14 | 2014-07-14 | 2014-06-14 | 2014-05-14 | 2014-04-14 | 2014-03-14 | 2014-02-14 | 2014-01-14 | 2013-12-14 | 2013-11-14 | 2013-10-14 | 2013-09-14 | 2013-08-14 | 2013-07-14 | 2013-06-14 | 2013-05-14 | 2013-04-14 | 2013-03-14 | 2013-02-14 | 2013-01-14 | 2012-12-14 | 2012-11-14 | 2012-10-14 | 2012-09-14 | 2012-08-14 | 2012-07-14 | 2012-06-14 | 2012-05-14 | 2012-04-14 | 2012-03-14 | 2012-02-14 | 2012-01-14 | 2011-12-14 | 2011-11-14 | 2011-10-14 | 2011-09-14 | 2011-08-14 | 2011-07-14 | 2011-06-14 | 2011-05-14 | 2011-04-14 | 2011-03-14 | 2011-02-14 | 2011-01-14 | 2010-12-14 | 2010-11-14 | 2010-10-14 | 2010-09-14 | 2010-08-14 | 2010-07-14 | 2010-06-14 | 2010-05-14 | 2010-04-14 | 2010-03-14 | 2010-02-14 | 2010-01-14 | 2009-12-14 | 2009-11-14 | 2009-10-14 | 2009-09-14 | 2009-08-14 | 2009-07-14 | 2009-06-14 | 2009-05-14 | 2009-04-14 | 2009-03-14 | 2009-02-14 | 2009-01-14 | 2008-12-14 | 2008-11-14 | 2008-10-14 | 2008-09-14 | 2008-08-14 | 2008-07-14 | 2008-06-14 | 2008-05-14 | 2008-04-14 | 2008-03-14 | 2008-02-14 | 2008-01-14 | 2007-12-14 | 2007-11-14 | 2007-10-14 | 2007-09-14 | 2007-08-14 | 2007-07-14 | 2007-06-14 | 2007-05-14 | 2007-04-14 | 2007-03-14 | 2007-02-14 | 2007-01-14 | 2006-12-14 | 2006-11-14 | 2006-10-14 | 2006-09-14 | 2006-08-14 | 2006-07-14 | 2006-06-14 | 2006-05-14 | 2006-04-14 | 2006-03-14 | 2006-02-14 | 2006-01-14 | 2005-12-14 | 2005-11-14 | 2005-10-14 | 2005-09-14 | 2005-08-14 | 2005-07-14 | 2005-06-14 | 2005-05-14 | 2005-04-14 | 2005-03-14 | 2005-02-14 | 2005-01-14 | 2004-12-14 | 2004-11-14 | 2004-10-14 | 2004-09-14 | 2004-08-14 | 2004-07-14 | 2004-06-14 | 2004-05-14 | 2004-04-14 | 2004-03-14 | 2004-02-14 | 2004-01-14 | 2003-12-14 | 2003-11-14 | 2003-10-14 | 2003-09-14 | 2003-08-14 | 2003-07-14 | 2003-06-14 | 2003-05-14 | 2003-04-14 | 2003-03-14 | 2003-02-14 | 2003-01-14 | 2002-12-14 | 2002-11-14 | 2002-10-14 | 2002-09-14 | 2002-08-14 | 2002-07-14 | 2002-06-14 | 2002-05-14 | 2002-04-14 | 2002-03-14 | 2002-02-14 | 2002-01-14 | 2001-12-14 | 2001-11-14 | 2001-10-14 | 2001-09-14 | 2001-08-14 | 2001-07-14 | 2001-06-14 | 2001-05-14 | 2001-04-14 | 2001-03-14 | 2001-02-14 | 2001-01-14 | 2000-12-14 | 2000-11-14 | 2000-10-14 | 2000-09-14 | 2000-08-14 | 2000-07-14 | 2000-06-14 | 2000-05-14 | 2000-04-14 | 2000-03-14 | 2000-02-14 | 2000-01-14 | 1999-12-14

Key: Value:

Key: Value:

MESSAGE
DATE 2017-06-02
FROM Ruben Safir
SUBJECT Subject: [Hangout - NYLXS] Neural Sciences and Coding
http://www.nature.com/neuro/journal/v20/n6/full/nn.4550.html
Toward standard practices for sharing computer code and programs in
neuroscience

Stephen J Eglen1, Ben Marwick2, Yaroslav O Halchenko3, Michael
Hanke4, 5, Shoaib Sufi6, Padraig Gleeson7, R Angus Silver7, Andrew P
Davison8, Linda Lanyon9, Mathew Abrams9, Thomas Wachtler10, David J
Willshaw11, Christophe Pouzat12, Jean-Baptiste Poline13,

Computational techniques are central in many areas of neuroscience and
are relatively easy to share. This paper describes why computer programs
underlying scientific publications should be shared and lists simple
steps for sharing. Together with ongoing efforts in data sharing, this
should aid reproducibility of research.
Subject terms:


Many areas of neuroscience are now critically dependent on computational
tools to help understand the large volumes of data being created.
Furthermore, computer models are increasingly being used to help predict
and understand the function of the nervous system. Many of these
computations are complex and usually cannot be concisely reported in the
methods section of a scientific article. In a few areas there are widely
used software packages for analysis (for example, SPM, FSL, AFNI,
FreeSurfer and Civet in neuroimaging) or simulation (for example,
NEURON, NEST, Brian). However, we often write new computer programs to
solve specific problems in the course of our research. Some of these
programs may be relatively small scripts that help analyze all of our
data, and these rarely get described in papers. As authors, how best can
we maximize the chances that other scientists can reproduce our
computations, find errors or reuse our methods on their data? Is our
research reproducible1?

To date, the sharing of computer programs underlying neuroscience
research has been the exception (see below for some examples) rather
than the rule. However, there are many potential benefits to sharing
these programs, including increased understanding and reuse of your
work. Furthermore, open source programs can be scrutinized and improved,
whereas the functioning of closed source programs remains forever
unclear2. Funding agencies, research institutes and publishers are all
gradually developing policies to reduce the withholding of computer
programs relating to research3. The Nature family of journals has
published opinion pieces in favor of sharing whatever code is available,
in whatever form4, 5. Since October 2014, all Nature journals require
papers to include a statement declaring whether the programs underlying
central results in a paper are available. In April 2015, Nature
Biotechnology offered recommendations for providing code with papers and
began asking referees to give feedback on their ability to test code
that accompanies submitted manuscripts6. In July 2015, F1000Research
stated that “software papers describing non-open software, code and/or
web tools will be rejected”7. Also in July 2015, BioMed Central
introduced a minimum-standards-of-reporting checklist for BMC
Neuroscience and several other journals, requiring submissions to
include a code availability statement and for code to be cited using a
DOI or similar unique identifier8. We believe that all journals should
adopt policies that strongly encourage or even mandate the sharing of
software relating to journal publications, as this is the only practical
way to check the validity of the work.
What should be shared?

It may not be obvious what to share, especially for complex projects
with many collaborators. As advocated by Claerbout9 and Donoho10, for
computational sciences, the scholarship is not the article; the
“scholarship is the complete software [...]”10. So, ideally, we should
share all code and data needed to allow others to reproduce our work,
but this may not be possible or practical. However, it is expected that
the key parts of the work should be shared, for example, implementations
of novel algorithms or analyses. At a minimum, we suggest following the
recommendation of submission of work to ModelDB11, i.e., to share enough
code, data and documentation to allow at least one key figure from your
manuscript to be reproduced. However, by adopting appropriate software
tools, as described in the next section, it is now relatively
straightforward to share the materials required to regenerate all
figures and tables. Code that already exists, is well tested and
documented, and is reused in the analysis should be cited. Ideally, all
other code should be communicated, including code that performs simple
preprocessing or statistical tests and code that deals with local
computing issues such as hardware and software configurations. While
this code may not be reusable, it will help others understand how
analyses are performed, find potential mistakes and aid reproducibility.
Finally, if the work is computationally intensive and requires a long
time to run (for example, many weeks), one may prefer to provide a small
'toy' example to demonstrate the code.

By getting into the habit of sharing as much as possible, not only do we
help others who wish to reproduce our work (which is a basic tenet of
the scientific method), we will be helping other members of our
laboratory or even ourselves in the future. By sharing our code
publicly, we are more likely to write higher-quality code12, and we will
know where to find it after we have moved on from the project13, rather
than having the code disappear on a colleague's laptop when they leave
your group or suffer some misfortune14. We also will be part of a
community and benefit from the code shared by others, thus reducing
software development time for ourselves and others.
Simple steps to help you share code

Once you have decided what to share, here are some simple guidelines for
how to share the work. Ideally, these principles should be followed
throughout the lifetime of the research project, not just at the end
when we wish to publish our results. Guidelines similar to these have
been proposed in many areas of science15, 16, 17, suggesting that they
are part of norms that are emerging across disciplines. In the 'Further
reading' section (Box 1), we list some specific proposals from other
fields that expand on the guidelines we suggest here. Box 2 describes
several online communities for discussing issues around code sharing.
Box 1: Further reading
Full box
Box 2: Online communities discussing code sharing
Full box
Version control

Use a version control system (such as Git) to develop the code18. The
version control repository can then be easily and freely shared with
others using sites such as http://github.com19 or https://bitbucket.org.
These sites allow you fine control over private versus public access to
your code. This means that you can keep your code repository private
during its development and then publicly share the repository at a later
stage (for example, at the time of publication), although we recommend
opening the code from the start of the project. It also makes it easy
for others to contribute to your code and to adapt it for their own uses.
Persistent URLs

Generate stable URLs (such as a DOI) for key versions of your software.
Unique identifiers are a key element in demonstrating the integrity and
reproducibility of research20, and they allow you to reference the exact
version of your code used to produce figures. DOIs can be obtained
freely and routinely with sites such as http://zenodo.org and
http://figshare.com. If your work includes computer models of neural
systems, you may wish to consider depositing these models in established
repositories such as ModelDB11, Open Source Brain21 or NITRC22. Some of
these sites allow for private sharing of repositories with anonymous
peer reviewers. Journal articles that include a persistent URL to code
deposited in a trusted repository meet the requirements of level two of
the “analytic methods (code) transparency” standard of the Transparency
and Openness Promotion guidelines15.
License

Choose a suitable license for your code to assert how you wish others to
reuse your code. For example, to maximize reuse, you may wish to use a
permissive license such as MIT or BSD23. Licenses are also important to
protect you from others misusing your code. Visit
http://choosealicense.com/ to get a simple overview of which license to
choose or
http://www.software.ac.uk/resources/guides/adopting-open-source-licence
for a detailed guide.
Etiquette

When working with code written by others, observe Daniel Kahneman's
'reproducibility etiquette'24 and have a discussion with the authors of
the code to give them a chance to fix bugs or respond to issues you have
identified before you make any public statements. Cite their code in an
appropriate fashion.
Documentation

Contrary to popular expectations, you do not need to write extensive
documentation or a user's guide for the code to still be useful to
others4. However, it is worth providing a minimal README file to
describe what the code does and how to run it. For example, you should
provide instructions on how to regenerate key results or a particular
figure from a paper. Literate programming methods, in which code and
narrative text are interwoven in the same document, make documentation
semiautomatic and can save a lot of time when preparing code to
accompany a publication25, 26. However, these methods admittedly take
more time to write in the first instance, and you should be prepared to
rewrite documentation when rewriting code. In any cases, well-documented
code allows for easier reuse and checking.
Tools

Consider using modern, widely used software tools that can help with
making your computational research reproducible. Many of these tools
have already been used in neuroscience and serve as good examples to
follow, for example, Org mode27, IPython/Jupyter28 and Knitr29.
Virtualization environments, such as VirtualBox appliances and Docker
containers, can also be used to encapsulate or preserve the entire
computational environment so that other users can run your code without
having to install numerous dependencies30.
Case studies

In addition to the examples listed above in “Tools”27, 28, 29, there are
many prior examples to follow when sharing your code. Some prominent
examples of reproducible research in computational neuroscience include
Vogels et al.31 and Waskom et al.32; see
https://github.com/WagnerLabPapers for details. The ModelDB repository
contains over 1,000 computational models deposited with instructions for
reproducing key figures to papers; for example, see
https://senselab.med.yale.edu/ModelDB/showModel.cshtml?model=93321 for a
model of activity-dependent conductances33.
Data

Any experimental data collected alongside the software should also be
released or made available. For small data sets, this could be stored
alongside the software, although it may be preferable to store
experimental data separately in an appropriate repository. Both PLOS and
Scientific Data maintain useful lists of subject-specific and general
repositories for data storage; see
http://journals.plos.org/plosbiology/s/data-availability#loc-recommended-repositories
and http://www.nature.com/sdata/policies/repositories.
Standards

Use of (community) standards, where appropriate, should be encouraged,
particularly use of nonproprietary formats to enable long-term
accessibility. In computational neuroscience, for example, PyNN34 and
NeuroML35 are widely used formats for making models more accessible and
portable across multiple simulators. Neuroimaging data and results can
be organized using BIDS36.
Tests

Testing the code has long been recognized as a critical step in the
software industry, but the practice has not yet been widely adopted by
researchers. We recommend including test suites demonstrating that the
code is producing the correct results37. These tests can be at a low
level (testing each individual function, called unit testing) or at a
higher level (for example, testing that the program yields correct
answers on simulated data)38. With public data available, it is often
straightforward to have a test verifying that published results can be
recomputed. Linking tests to continuous integration services (such as
Travis CI, https://travis-ci.org) allows these tests to be automatically
run each time a change is made to the code, ensuring that failing tests
are immediately flagged and can be dealt with quickly.
User support

Although some people are eager to provide support for their code after
it has been published, others may feel that they do not want to be
burdened by, for example, feature requests. One simple suggestion to
avoid this is to establish a user community for the code39. This could
be as simple as creating a mailing list or asking for issues to be
posted on a GitHub repository.
Closing remarks

Changing the behaviors of neuroscientists so that they make their code
more available will likely be resisted by those who do not see the
community benefits as outweighing the personal costs of the time and
effort required to share code40. The community benefits, in our view,
are obvious and substantial: we can more robustly and transparently
demonstrate the reliability of our results, we can more easily adapt
methods developed by others to our data and we can increase the impact
of our work as others can similarly reuse our methods on their data.
Thus, we will endeavor to lead by example and follow all these practices
as part of our future work in all scientific publications. Even if the
code we produce today will not run ten years from now, it will still be
a more precise and complete expression of our analysis than the text of
the methods section in our paper.

However, exhortations such as this article are only a small part of
making code sharing a normal part of doing neuroscience; many other
activities are important. All researchers should be trained in sound
coding principles; such training is provided by organizations such as
Software Carpentry38 or Data Carpentry and through national
neuroinformatics initiatives such as http://python.g-node.org.
Furthermore, we should request code and data when reviewing, and we
should submit to and review for journals that support code sharing.
Grant proposals should be checked for mentions of code availability, and
we should encourage efforts toward openness in hiring, promotion and
letters of reference41. Funding agencies and editors should also
consider mandating code sharing by default. This combination of efforts
on a variety of fronts will increase the visibility of research
accompanied by open-source code and demonstrate to others in the
discipline that code sharing is a desirable activity that helps move the
field forward.

We believe that the sociological barriers to code sharing are harder to
overcome than the technical ones. Currently, academic success is
strongly linked to publications and there is little recognition for
producing and sharing code. Code may also be seen as providing a private
competitive advantage to researchers. We challenge this view and propose
that code be regarded as a research product and as part of the
publication, in which it should be shared by default, and that those
conducting publicly funded research should have an obligation to share
code. We hope that in the future code sharing becomes the norm.
Moreover, we are advocating for code sharing as part of a broader
culture change embracing transparency, reproducibility and the
reusability of research products.
Author contributions

All authors contributed to discussions and to writing and editing the
manuscript.
References

References• Acknowledgments• Author information

Challenges in irreproducible research. Nature
http://www.nature.com/nature/focus/reproducibility (2017).
Vihinen, M. Nature 521, 261 (2015).
Morin, A. et al. Science 336, 159–160 (2012).
CAS
PubMed
Article
Barnes, N. Nature 467, 753 (2010).
CAS
PubMed
Article
Ince, D.C., Hatton, L. & Graham-Cumming, J. Nature 482, 485–488 (2012).
CAS
ISI
PubMed
Article
Anonymous. Nat. Biotechnol. 33, 319 (2015).
Article
Preparing a Software Tool article. F1000 Research
https://f1000research.com/for-authors/article-guidelines/software-tool-articles
(2015).
Kenall, A. et al. BMC Neurosci. 16, 44 (2015).
Claerbout, J. & Karrenbach, M. Electronic documents give
reproducible research a new meaning. in Proc. 62nd Ann. Int. Meeting of
the Soc. of Exploration Geophysics 601–604 (1992).
Donoho, D.L. Biostatistics 11, 385–388 (2010).
PubMed
Article
Hines, M.L., Morse, T., Migliore, M., Carnevale, N.T. & Shepherd,
G.M. J. Comput. Neurosci. 17, 7–11 (2004).
ISI
PubMed
Article
Easterbrook, S.M. Nat. Geosci. 7, 779–781 (2014).
Article
Halchenko, Y.O. & Hanke, M. Gigascience 4, 31 (2015).
Berg, J. Science 354, 1242 (2016).
Nosek, B.A. et al. Science 348, 1422–1425 (2015).
CAS
PubMed
Article
Miguel, E. et al. Science 343, 30–31 (2014).
ISI
PubMed
Article
Stodden, V., Guo, P. & Ma, Z. How journals are adopting open data
and code policies. in First Global Thematic IASC Conference on the
Knowledge Commons: Governing Pooled Knowledge Resources (2012).
Blischak, J.D., Davenport, E.R. & Wilson, G. PLOS Comput. Biol. 12,
e1004668 (2016).
PubMed
Article
Ram, K. Source Code Biol. Med. 8, 7 (2013).
PubMed
Article
Vasilevsky, N.A. et al. PeerJ 1, e148 (2013).
PubMed
Article
Gleeson, P., Silver, A. & Cantarelli, M. in Encyclopedia of
Computational Neuroscience (Jaeger, D. & Jung, R., eds.) 2153–2156
(Springer New York, 2014).
Poline, J.-B. & Kennedy, D. in Encyclopedia of Computational
Neuroscience (Jaeger, D. & Jung, R., eds.) 2733–2744 (Springer New York,
2014).
Stodden, V. Comput. Sci. Eng. 11, 35–40 (2009).
Kahneman, D. Soc. Psychol. 45, 310–311 (2014).
Schulte, E., Davison, D., Dye, T. & Dominik, C. J. Stat. Softw.
http://dx.doi.org/10.18637/jss.v046.i03 (2012).
Gentleman, R. & Lang, D.T. J. Comput. Graph. Stat. 16, 1–23 (2007).
Delescluse, M., Franconville, R., Joucla, S., Lieury, T. & Pouzat,
C. J. Physiol. Paris 106, 159–170 (2012).
Stevens, J.-L.R., Elver, M. & Bednar, J.A. Front. Neuroinform. 7, 44
(2013).
Eglen, S.J. et al. Gigascience 3, 3 (2014).
Boettiger, C. Oper. Syst. Rev. 49, 71–79 (2015).
Article
Vogels, T.P., Sprekeler, H., Zenke, F., Clopath, C. & Gerstner, W.
Science 334, 1569–1573 (2011).
CAS
ISI
PubMed
Article
Waskom, M.L., Kumaran, D., Gordon, A.M., Rissman, J. & Wagner, A.D.
J. Neurosci. 34, 10743–10755 (2014).
CAS
PubMed
Article
Liu, Z., Golowasch, J., Marder, E. & Abbott, L.F. J. Neurosci. 18,
2309–2320 (1998).
CAS
ISI
PubMed
Davison, A.P. et al. Front. Neuroinform. 2, 11 (2009).
Cannon, R.C. et al. Front. Neuroinform. 8, 79 (2014).
Gorgolewski, K.J. et al. Sci. Data 3, 160044 (2016).
PubMed
Article
Axelrod, V. Front. Psychol. 5, 1435 (2014).
Wilson, G. et al. PLoS Biol. 12, e1001745 (2014).
PubMed
Article
Gorgolewski, K.J. & Poldrack, R.A. PLoS Biol. 14, e1002506 (2016).
PubMed
Article
Stodden, V. The Scientific Method in Practice: Reproducibility in
the Computational Sciences. MIT Sloan School Working Paper 4773–10
http://dx.doi.org/10.2139/ssrn.1550193 (2010).
LeVeque, R.J., Mitchell, I.M. & Stodden, V. Comput. Sci. Eng. 14, 13
(2012).
Article
Tippmann, S. Nature http://doi.org/doi:10.1038/nature.2014.16014 (2014).
Perez-Riverol, Y. et al. PLOS Comput. Biol. 12, e1004947 (2016).
PubMed
Article

Download references
Acknowledgments

References• Acknowledgments• Author information

This article is based on discussions from a workshop to encourage
sharing in neuroscience, held in Cambridge, UK, December 2014. It was
financially supported and organized by the International
Neuroinformatics Coordinating Facility (http://www.incf.org), with
additional support from the Software Sustainability institute
(http://www.software.ac.uk). M.H. was supported by funds from the German
federal state of Saxony-Anhalt and the European Regional Development
Fund (ERDF), Project: Center for Behavioral Brain Sciences.
Author information

References• Acknowledgments• Author information

Affiliations

Cambridge Computational Biology Institute, Department of Applied
Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK.
Stephen J Eglen
Department of Anthropology, University of Washington, Seattle,
Washington, USA.
Ben Marwick
Department of Psychological and Brain Sciences, Dartmouth College,
Hanover, New Hampshire, USA.
Yaroslav O Halchenko
Institute of Psychology II, Otto-von-Guericke-University Magdeburg,
Magdeburg, Germany.
Michael Hanke
Center for Behavioral Brain Sciences, Magdeburg, Germany.
Michael Hanke
Software Sustainability Institute, University of Manchester,
Manchester, UK.
Shoaib Sufi
Department of Neuroscience, Physiology and Pharmacology, University
College London, London, UK.
Padraig Gleeson & R Angus Silver
Unité de Neurosciences, Information et Complexité, CNRS, Gif sur
Yvette, France.
Andrew P Davison
International Neuroinformatics Coordinating Facility, Karolinska
Institutet, Stockholm, Sweden.
Linda Lanyon & Mathew Abrams
Department of Biology II, Ludwig-Maximilians-Universität München,
Munich, Germany.
Thomas Wachtler
Institute for Adaptive and Neural Computation, School of
Informatics, University of Edinburgh, Edinburgh, UK.
David J Willshaw
MAP5 Paris-Descartes University and CNRS UMR 8145, Paris, France.
Christophe Pouzat
Henry H. Wheeler, Jr. Brain Imaging Center, Helen Wills Neuroscience
Institute, University of California, Berkeley, Berkeley, California, USA.
Jean-Baptiste Poline

Competing financial interests

The authors declare no competing financial interests.
Corresponding authors

Correspondence to:

Stephen J Eglen or Jean-Baptiste Poline

Author details

Stephen J Eglen

Contact Stephen J Eglen
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-8607-8025
Ben Marwick
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-7879-4531
Yaroslav O Halchenko
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0003-3456-2493
Michael Hanke
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-6398-6370
Shoaib Sufi
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-6390-2616
Padraig Gleeson
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-5963-8576
R Angus Silver
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0002-5480-6638
Andrew P Davison
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0002-4793-7541
Linda Lanyon
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0002-0885-1825
Mathew Abrams
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0001-9438-9691
Thomas Wachtler
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0003-2015-6590
David J Willshaw
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0003-3814-7529
Christophe Pouzat
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0002-2844-8099
Jean-Baptiste Poline

Contact Jean-Baptiste Poline
Search for this author in:
Nature Research journals• PubMed• Google Scholar• ORCID:
https://orcid.org/0000-0002-9794-749X

_______________________________________________
Hangout mailing list
Hangout-at-nylxs.com
http://www.nylxs.com/mailman/listinfo/hangout

  1. 2017-06-02 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Neural Sciences and Coding
  2. 2017-06-02 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Neural Sciences and Coding
  3. 2017-06-02 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Blue Colar Coders
  4. 2017-06-03 Rick Moen <rick-at-linuxmafia.com> Subject: [Hangout - NYLXS] (forw) Re: [skeptic] FWD: Fleeing the Paris
  5. 2017-06-03 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Movie of the Weeks
  6. 2017-06-04 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] If you see something, say something!
  7. 2017-06-05 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Healthcare coding
  8. 2017-06-05 Gabor Szabo <gabor-at-szabgab.com> Subject: [Hangout - NYLXS] [Perlweekly] #306 - Perl 5.26.0 is now available!
  9. 2017-06-05 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Project for PhP business app
  10. 2017-06-06 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] github thread with RMS
  11. 2017-06-05 James E Keenan <jkeenan-at-pobox.com> Subject: [Hangout - NYLXS] TPC::NA::2017: Propose lightning talks
  12. 2017-06-05 James E Keenan <jkeenan-at-pobox.com> Subject: [Hangout - NYLXS] TPC 2017 schedule has been posted; Registration;
  13. 2017-06-05 Glenn Randers-Pehrson <glennrp-at-gmail.com> Subject: [Hangout - NYLXS] [png-mng-implement] Off-by-one bug in libpng16
  14. 2017-06-06 mrbrklyn <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] London lowdown
  15. 2017-06-06 mrbrklyn <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] [png-mng-implement] Off-by-one bug in
  16. 2017-06-06 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] London lowdown
  17. 2017-06-06 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] London lowdown
  18. 2017-06-06 ISOC-NY announcements <announce-at-lists.isoc-ny.org> Subject: [Hangout - NYLXS] =?utf-8?q?=5Bisoc-ny=5D_Call_for_Proposals_?=
  19. 2017-06-06 Glenn Randers-Pehrson <glennrp-at-gmail.com> Subject: [Hangout - NYLXS] [png-mng-implement] libpng-1.6.30beta04 is
  20. 2017-06-06 andy bang <andy.bang-at-oracle.com> Subject: [Hangout - NYLXS] MySQL Enterprise Monitor 3.4.1 has been released
  21. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Fwd: tx path circular buffer
  22. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] reactjs
  23. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Midevil Castles, the Maginot Line, and now this
  24. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] The Foreign Policy Faliure that keeps on giving
  25. 2017-06-07 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] The Foreign Policy Faliure that keeps on
  26. 2017-06-07 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] The Inevitable Connection Between Artificial
  27. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Survailence Cameras on the cloud
  28. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] AI and surveillance
  29. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] ISIS may be using DJI consumer drones for
  30. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Snowden
  31. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] US envoy Haley berates UN rights council,
  32. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] London lowdown
  33. 2017-06-07 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] London lowdown
  34. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] London lowdown
  35. 2017-06-07 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] London lowdown
  36. 2017-06-07 Greg KH <greg-at-kroah.com> Re: [Hangout - NYLXS] tx path circular buffer
  37. 2017-06-07 ruth02-at-web.de Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  38. 2017-06-07 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  39. 2017-06-07 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  40. 2017-06-07 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  41. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  42. 2017-06-07 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Human rights and the UN
  43. 2017-06-08 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  44. 2017-06-08 mrbrklyn <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] CT Scans and 3d printing
  45. 2017-06-08 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  46. 2017-06-08 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] the surveillance state
  47. 2017-06-08 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] resume google trick
  48. 2017-06-08 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Coding Repos
  49. 2017-06-08 From: "Mancini, Sabin (DFS)" <Sabin.Mancini-at-dfs.ny.gov> Re: [Hangout - NYLXS] [Hangout of NYLXS] : Debian derivative that
  50. 2017-06-08 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] : Debian derivative that
  51. 2017-06-09 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] : Debian derivative that
  52. 2017-06-09 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  53. 2017-06-09 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] : Debian derivative that
  54. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in news
  55. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] : Debian derivative that
  56. 2017-06-09 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Abbott Scam
  57. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  58. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  59. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  60. 2017-06-09 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  61. 2017-06-10 ruth02-at-web.de Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in
  62. 2017-06-10 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] [Hangout of NYLXS] - Rick M girlfriend in
  63. 2017-06-10 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Movie of the Week
  64. 2017-06-10 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Abbott Scam
  65. 2017-06-10 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  66. 2017-06-11 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] Abbott Scam
  67. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam
  68. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam
  69. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam
  70. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam
  71. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam
  72. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Abbott Scam - tightening the nose on the
  73. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  74. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  75. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  76. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  77. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  78. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] PBMs and Rebates... lets not just blame Abbott
  79. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] Abbotts lies in its markets
  80. 2017-06-11 Rick Moen <rick-at-linuxmafia.com> Re: [Hangout - NYLXS] Abbott Scam
  81. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] Time to end the kickbacks and the control
  82. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Re: [Hangout - NYLXS] Time to end the kickbacks and the control
  83. 2017-06-11 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] Abbott Scam
  84. 2017-06-11 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] Abbott Scam
  85. 2017-06-11 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Fwd: Re: mod_perl and cgi-script handler
  86. 2017-06-11 From: "Ruben.Safir" <ruben.safir-at-my.liu.edu> Subject: [Hangout - NYLXS] Language Workshops
  87. 2017-06-11 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Suplementry IT training
  88. 2017-06-11 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] we'll always have Paris
  89. 2017-06-12 From: "Mancini, Sabin (DFS)" <Sabin.Mancini-at-dfs.ny.gov> Re: [Hangout - NYLXS] Abbott Scam: Wow. Ruben is pretty hot on this
  90. 2017-06-11 Gabor Szabo <gabor-at-szabgab.com> Subject: [Hangout - NYLXS] [Perlweekly] #307 - The Perl Conference is nearly
  91. 2017-06-12 From: "APhA's Pharmacy Today" <PTdaily-at-aphanet.org> Subject: [Hangout - NYLXS] =?utf-8?q?June_12=2C_2017=3A_Opioid_Crisis_Comp?=
  92. 2017-06-12 From: "soledad.esteban" <soledad.esteban-at-icp.cat> Subject: [Hangout - NYLXS] [dinosaur] International course on Scientific
  93. 2017-06-13 From: "Chaim Desser" <career-at-poelgroup.com> Subject: [Hangout - NYLXS] position to review
  94. 2017-06-13 James E Keenan <jkeenan-at-pobox.com> Subject: [Hangout - NYLXS] TPC here and there
  95. 2017-06-14 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] busy today with corruption on linkedin
  96. 2017-06-15 From: "Yi Qian, IEEE ICC'18 TPC Chair" <noreply-at-comsoc.org> Subject: [Hangout - NYLXS] IEEE ICC'18 Call for Workshop Proposals &
  97. 2017-06-17 ruth02-at-web.de Re: [Hangout - NYLXS] [Hangout of NYLXS] - Guarantee- I am not in
  98. 2017-06-19 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] MTA extortion
  99. 2017-06-19 Mark Halegua <phantom21-at-mindspring.com> Re: [Hangout - NYLXS] MTA extortion
  100. 2017-06-19 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Jobs
  101. 2017-06-20 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Jobs
  102. 2017-06-20 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Movie of the Week
  103. 2017-06-23 Kevin Zheng <kevinz5000-at-gmail.com> Subject: [Hangout - NYLXS] [crossfire] Release proposal
  104. 2017-06-23 Mark Wedel <mwedel-at-sonic.net> Re: [Hangout - NYLXS] [crossfire] Release proposal
  105. 2017-06-23 Rick Tanner <leaf-at-real-time.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  106. 2017-06-23 Kevin Zheng <kevinz5000-at-gmail.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  107. 2017-06-23 Kevin Zheng <kevinz5000-at-gmail.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  108. 2017-06-23 Matthew Giassa <matthew-at-giassa.net> Re: [Hangout - NYLXS] [crossfire] Release proposal
  109. 2017-06-23 Preston Crow <pc-crossfire06-at-crowcastle.net> Subject: [Hangout - NYLXS] [crossfire] Crossfire maps idea
  110. 2017-06-23 David Hurst <davidnicholashurst-at-gmail.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  111. 2017-06-23 Rick Tanner <leaf-at-real-time.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  112. 2017-06-23 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  113. 2017-06-23 From: "Meaningful Beauty" <MeaningfulBeauty-at-islerpatto.stream> Subject: [Hangout - NYLXS] Youthful looking Skin + Free-Shipping
  114. 2017-06-23 David Hurst <davidnicholashurst-at-gmail.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  115. 2017-06-25 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] TED on the threat of AI in the Military
  116. 2017-06-26 Gabor Szabo <gabor-at-szabgab.com> Subject: [Hangout - NYLXS] [Perlweekly] #309 - csvgrep and the recipe for
  117. 2017-06-26 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Fishing images
  118. 2017-06-26 opensuse-security-at-opensuse.org Subject: [Hangout - NYLXS] [security-announce] SUSE-SU-2017:1669-1:
  119. 2017-06-26 opensuse-security-at-opensuse.org Subject: [Hangout - NYLXS] [security-announce] openSUSE-SU-2017:1685-1:
  120. 2017-06-26 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] Fishing images
  121. 2017-06-26 Rick Tanner <leaf-at-real-time.com> Re: [Hangout - NYLXS] [crossfire] Release proposal
  122. 2017-06-26 Rick Tanner <leaf-at-real-time.com> Subject: [Hangout - NYLXS] [crossfire] Expanded World Map (was: Release
  123. 2017-06-26 Rick Tanner <leaf-at-real-time.com> Re: [Hangout - NYLXS] [crossfire] Crossfire maps idea
  124. 2017-06-27 From: "S." <sman356-at-yahoo.com> Subject: [Hangout - NYLXS] Score: 9 - 0 ! WIN ! on SCOTUS
  125. 2017-06-23 From: "NYU Langone Careers" <nyumccareers-at-symphonytalent.com> Subject: [Hangout - NYLXS] Follow up from NYU Langone Medical Center
  126. 2017-06-28 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] family in need
  127. 2017-06-28 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] A train derailment
  128. 2017-06-28 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] A train derailment
  129. 2017-06-28 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Must See website
  130. 2017-06-28 Ruben Safir <ruben-at-mrbrklyn.com> Re: [Hangout - NYLXS] A train derailment
  131. 2017-06-28 Ruben Safir <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] Fwd: [manjaro-general] Manjaro-Architect ISO
  132. 2017-06-29 ruben <ruben-at-mrbrklyn.com> Subject: [Hangout - NYLXS] time to put down the phone
  133. 2017-06-29 From: "Mancini, Sabin (DFS)" <Sabin.Mancini-at-dfs.ny.gov> Re: [Hangout - NYLXS] Lottery programmer rigs systems in 4 states,
  134. 2017-06-30 Ruben Safir <mrbrklyn-at-panix.com> Subject: [Hangout - NYLXS] Dinosaur found in Amber

NYLXS are Do'ers and the first step of Doing is Joining! Join NYLXS and make a difference in your community today!