\documentclass{article}
\usepackage[affil-it]{authblk}
\usepackage{graphicx}
\usepackage[space]{grffile}
\usepackage{latexsym}
\usepackage{textcomp}
\usepackage{longtable}
\usepackage{tabulary}
\usepackage{booktabs,array,multirow}
\usepackage{amsfonts,amsmath,amssymb}
\providecommand\citet{\cite}
\providecommand\citep{\cite}
\providecommand\citealt{\cite}
\usepackage{url}
\usepackage{hyperref}
\hypersetup{colorlinks=false,pdfborder={0 0 0}}
\usepackage{etoolbox}
\makeatletter
\patchcmd\@combinedblfloats{\box\@outputbox}{\unvbox\@outputbox}{}{%
  \errmessage{\noexpand\@combinedblfloats could not be patched}%
}%
\makeatother
% You can conditionalize code for latexml or normal latex using this.
\newif\iflatexml\latexmlfalse
\AtBeginDocument{\DeclareGraphicsExtensions{.pdf,.PDF,.eps,.EPS,.png,.PNG,.tif,.TIF,.jpg,.JPG,.jpeg,.JPEG}}

\usepackage[utf8]{inputenc}
\usepackage[english]{babel}

\def\onlyHTML#1{\iflatexml #1\fi}
\def\onlyPDF#1{\iflatexml\else #1\fi} 


\begin{document}

\title{Open Source Molecular Modeling}


\author{David Koes}
\affil{Affiliation not available}

  
\author{Jocelyn Sunseri}
\affil{Affiliation not available}
  
\author{Somayeh Pirhadi}
\affil{Affiliation not available}
  



\date{\today}

\maketitle




\section{Introduction}

\subsection*{What is Open Source?}

Free and open source software (FOSS) is software that is both considered ``free software,'' as defined by the Free Software Foundation (\url{http://fsf.org}) and ``open source,'' as defined by the Open Source Initiative (\url{http://opensource.org}).  The distinctions between free and open source software are largely philosophical  - the free software movement is primary motivated by user freedoms ("free as in speech, not free as in beer") while the open source movement is more concerned with promoting an open development model to enhance software quality.  However, as a practical matter, especially with regards to scientific software, such distinctions remain philosophical rather than practical as the most popular software licenses are both free and open source.  

The unifying theme of open source software licenses is that they allow users to use, modify, and distribute software without significant restrictions.  This is achieved by making the full source code of the software available to users.  Broadly speaking, open source licenses fall into two categories: permissive and copyleft. Permissive licenses, such as the Apache, BSD, MIT, and Python licenses, place minimal restrictions on how modified code may be distributed, such as requiring attribution and limiting liability.  They specifically do not require that redistributions of modified source code be licensed under the same license as the original source code.  This enables source code licensed under a permissive license to be incorporated into commercial, proprietary programs that are not open source.  In contrast, copyleft licenses, such as the different versions of the GNU Public License (GPL), require that public redistributions of licensed software remain licensed under a GPL license.  
That is, the source code must remain publicly and freely available. 
 The GNU Lesser General Public License (LGPL) is slightly less restrictive version of the GPL used primarily for libraries as it does not require software that uses LGPL licensed software as a library to be licensed under the LGPL.
Although copyleft licenses do not prohibit selling software, since the full source code must remain freely available, in practice vendors of copylefted software must commercialize the support of the product, rather than the product itself.
Finally, we note there are other software licenses that make source code available, but are not open source licenses.  These licenses typically prohibit the redistribution of the source code.  Such licenses, which we will refer to as ``source-available'' licenses, have some popularity in academia as they allow source code to be distributed to other researchers in non-profit institutions, but allow the code to be sold to commercial entities. 

\subsection*{Advantages and Disadvantages of Open Source}

The value of open source software in cheminformatics and molecular modeling is somewhat controversial.  Unsurprisingly, those affiliated with commercial scientific software argue that traditional commercial development, with its associated support and continuous development, provides a superior value \cite{Krylov_2015}, while open source advocates feel the benefits outweigh the burdens \cite{Gezelter_2015,Jacob_2016}. Our goal is not to revisit these arguments.  Instead, we assert that open source scientific software is a \textit{de facto} part of the scientific community, and so in this review we catalog those open source packages that fall within the domain of cheminformatics and molecular modeling.

There are a few aspects of the open source software debate that we find particularly relevant.  First, opponents are right to point out that free software is not free - users of open source software generally take on a much greater burden in supporting the software than with commercial software.  This is one reason why it is important, when possible, to seek open source software that is under active development and supported by a broad community.  Therefore, in this review we attempt to quantify the current level of development and usage of each package as an indirect measure of quality and usability.  Second, the primary advantage of open source software is the ability to redistribute code without restriction.  This inherently enables reproducibility and lets scientists ``stand on the shoulders of giants'' instead of reinventing the wheel. Consequently, in this review we limit ourselves to a survey of true open source software and exclude source-available software that may place restrictions on the publication of reproducible research results. 




\section{Methods}

We organize software packages into seven categories: cheminformatics, visualization, QSAR (quantitative structure--activity relationship) and ADMET modeling, quantum chemistry, ligand dynamics and free energy calculations, and virtual screening (including ligand design).
We identified open source software packages by browsing the relevant categories (Molecular Science, Chemistry, Bio-Informatics, Medical Science) on the popular SourceForge (\url{http://sourceforge.net}) repository, searching for categories on GitHub (\url{http://github.com}), searching for categories on OpenHub (\url{https://www.openhub.net}), searching for categories together with ``open source software'' on Google, and browsing the Click2Drug (\url{http://click2drug.org}) and VLS3D \cite{Villoutreix_2013} directories.  Finally, a draft document was tweeted (@david\_koes) to solicit suggestions for additional packages from the community.

For every identified software package, we report its primary URL and software license and assign it an activity code. For simplicity, BSD-like licenses (e.g. NCSA) are reported as BSD. Activity codes consist of a development activity level (alphabetical) and usage activity level (numerical). Activity codes were assigned as follows:
\subsubsection*{Development Activity}
\begin{description}
  \item[A] Substantial development (e.g. a new major release, the addition of new features, or substantial refinements of existing features) within the last 18 months. Note this includes all projects that were created in the last 18 months.
  \item[B] Evidence of some development within the last 18 months such as a minor release or bug fixes to a development branch.
  \item[C] No evidence of development (changes to the source code or documentation) within the last 18 months. Note that in cases where a package does not follow an open development model (i.e., source is only released with official releases) the estimate of development activity will be overly conservative.
\end{description}
\subsubsection*{Usage Activity}
\begin{enumerate}
  \item Substantial user usage within the last 18 months (more than 20 downloads a month on average from SourceForge, more than 20 stars or forks on GitHub, more than 10 citations a year, and/or a clearly active user community as indicated by traffic on mailing lists or discussion boards).
  \item Moderate user usage within the last 18 months.
    \item Minimal or no identifiable user usage within the last 18 months (fewer than 50 downloads total on SourceForge, three or fewer stars and/or forks on GitHub, or fewer than one citation a year).
\end{enumerate}

We omit some packages with extended periods of inactivity (e.g. more than 10 years) where there is little evidence of any usage or packages that are referenced in the literature but for which we could not find a extant source code repository.  We also omit packages that provide common and/or trivial functionality (e.g. molecular weight calculators) and those that require non-open source packages in order to function.



 
 

  
  

\section{Cheminformatics}
 
Cheminformatics involves the representation, manipulation and analysis of molecular data \cite{Leach_2007,Gasteiger_2003}. Cheminformatic toolkits, although they may contain standalone utility programs, are primarily designed to function as libraries for other programs so that common functions, such as parsing molecular data, need not be reimplemented.  As libraries, the native programming language of a toolkit is particularly relevant as it influences the language programs that integrate with the toolkit can be written in.  In some cases, alternative language bindings, which essentially translate between programming languages, may be available, but due to the use of different idioms by different languages (e.g. object-oriented vs. functional, manual vs. automatic memory management) use of these non-native bindings may be cumbersome.  In addition to toolkits, we catalog standalone programs, including conformer generators for converted 2D information into 3D molecular structures (some of which have been critically evaluated \cite{Ebejer_2012}), and graphical environments for creating and managing workflows.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
BALL & \url{http://www.ball-project.org/} & LGPL & A2 & \cite{Hildebrandt_2010}\\
CDK & \url{https://sourceforge.net/projects/cdk} & LGPL & A1 & \cite{Steinbeck_2006}\\
Chem$^f$ & \url{https://github.com/stefan-hoeck/chemf} & GPL & C2 & \cite{H_ck_2012}\\
chemfp & \url{http://chemfp.com} & MIT & C3 & \cite{dalke2011chemfp} \\
chemkit & \url {https://github.com/kylelutz/chemkit} & BSD & B1 & \\
ChemmineR & \url{https://www.bioconductor.org/packages/release/bioc/html/ChemmineR.html} & Artistic & A1 &  \cite{Cao_2008} \\
Cinfony & \url{https://github.com/cinfony/cinfony} & BSD/GPL & B1 & \cite{cinfony} \\
CurlySMILES & \url{http://www.axeleratio.com/csm/proj/main.htm} & GPL & C2 & \cite{Drefahl_2011} \\
DisCuS & \url{https://github.com/mwojcikowski/discus} & GPL & B3 & \cite{W_jcikowski_2014} \\
Fafoom & \url{https://github.com/adrianasupady/fafoom} & LGPL & A2 & \cite{Supady_2015} \\
fmcsR & \url{http://www.bioconductor.org/packages/fmcsR} & Artistic & A1 & \cite{Wang_2013}\\
frowns & \url{http://frowns.sourceforge.net} & Python & C2 & \\
Helium & \url{http://www.moldb.net/helium.html} & BSD & B2 & \\
Indigo & \url{http://lifescience.opensource.epam.com/indigo} & GPL & A1 &  \cite{Pavlov_2011}\\
JoeLib & \url{http://sourceforge.net/projects/joelib} & GPL & C1 & \\
LICSS & \url{https://github.com/KevinLawson/excel-cdk} & GPL & A2 & \cite{Lawson_2012}\\
MayaChemTools & \url{http://www.mayachemtools.org} & LGPL & A2 & \cite{sud2012mayachemtools}\\
Mychem & \url{http://mychem.sourceforge.net} & GPL & B2 & \\
ODDT & \url{https://github.com/oddt/oddt} & BSD & A2 &\cite{W_jcikowski_2015} \\
Open Babel & \url{http://openbabel.org} & GPL & A1 & \cite{openbabel}\\
OPSIN & \url{http://opsin.ch.cam.ac.uk} & Artistic & A1 & \cite{Lowe_2011} \\
OrChem & \url{http://orchem.sourceforge.net} & LGPL & C2 &\cite{Rijnbeek_2009} \\
osra & \url{http://sourceforge.net/projects/osra} & GPL & A1 & \cite{Filippov_2009}\\
OUCH & \url{https://github.com/odj/Ouch} & GPL & C2 & \\
pybel & \url{http://openbabel.org/docs/dev/UseTheLibrary/Python\_Pybel.html} & GPL & A1 & \cite{pybel} \\
rcdk & \url{https://cran.r-project.org/web/packages/rcdk} & LGPL & B2 & \cite{guha2007chemical}  \\
RDKit & \url{http://www.rdkit.org} & BSD & A1 & \\
RInChI & \url{http://www-rinchi.ch.cam.ac.uk} & Apache & A3 & \\
rpubchem & \url{https://r-forge.r-project.org/projects/rpubchem} & GPL & C3 & \\
rubabel & \url{https://github.com/princelab/rubabel} & MIT & C2 & \cite{Smith_2013} \\
SMSD & \url{http://www.ebi.ac.uk/thornton-srv/software/SMSD} & CCAL & B2 & \cite{Rahman_2009} \\
Som-it\textsuperscript{TM}  & \url{http://silicos-it.be} & LGPL & C3 & \\
webchem & \url{https://github.com/ropensci/webchem} & MIT & A2 & \\ 
    \end{tabular} 
\iflatexml\else
}
\fi

\caption{{\label{chemtool}  Open source cheminformatics toolkits.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
cApp & \url{http://www.structuralchemistry.org/pcsb} & GPL & A3 & \cite{Amani_2015}\\
checkmol/matchmol & \url{http://merian.pch.univie.ac.at/~nhaider/cheminf/cmmm.html} & GPL & C3 & \cite{Haider_2010} \\
ConvertMAS & \url{http://sourceforge.net/projects/convertmas} & GPL & A3 & \\
Filter-it\textsuperscript{TM}  & \url{http://silicos-it.be} & LGPL & C3 & \\
Frog2 & \url{https://github.com/tuffery/Frog2} & GPL & B2 &  \cite{Miteva_2010} \\
LMR & \url{https://github.com/IanAWatson/Lilly-Medchem-Rules} & GPL & B2 & \cite{Bruns_2012} \\
Molpher & \url{https://www.assembla.com/spaces/molpher/wiki} & GPL & C2 & \cite{Hoksza_2014}\\
MoSS & \url{http://www.borgelt.net/moss.html} & MIT & A2 & \cite{Borgelt_2005} \\
OMG & \url{http://sourceforge.net/projects/openmg} & GPL & C1 & \cite{Peironcely_2012}\\
sdf2xyz2sdf & \url{http://sdf2xyz2sdf.sourceforge.net} & GPL & C2 & \cite{Tosco_2011} \\
sdsorter & \url{https://sourceforge.net/projects/sdsorter} & GPL & B3 & \\
Shape & \url{http://sourceforge.net/projects/shapega} & GPL  & C3 & \cite{Rosen_2009}\\
Strip-it\textsuperscript{TM}  & \url{http://silicos-it.be} & LGPL & C3 & \\
    \end{tabular} 
\iflatexml\else
    }
\fi
    \caption{{\label{standalone}  Standalone open source cheminformatics software.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
AMBIT & \url{http://ambit.sourceforge.net} & GPL & A1 & \cite{Jeliazkova_2011}\\
Bioclipse & \url{http://www.bioclipse.net} & Eclipse& B1 &  \cite{Spjuth_2009}\\
Galaxy Tool & \url{https://github.com/bgruening/galaxytools} & Academic& A1 & \cite{Goecks_2010} \\
KNIME & \url{https://www.knime.org} & GPL & A1 & \cite{Berthold_2009}\\
Orange & \url{orange.biolab.si} & BSD & A1 & \cite{JMLR:demsar13a} \\
SA2 & \url{http://sa2.sourceforge.net} & GPL  & A1 & \cite{Guilloux_2012} \\
Taverna & \url{http://www.taverna.org.uk} & LGPL & A1 & \cite{Wolstencroft_2013} \\
Weka & \url{https://sourceforge.net/projects/weka} & GPL & A1 & \cite{Hall_2009} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{chemgui} Open source graphical development environments for cheminformatics.}}
\end{table}


\subsection*{Toolkits (Table~\ref{chemtool})} 
The Biochemical Algorithms Library (BALL) \cite{Hildebrandt_2010} provides an object-oriented C++ library for structural bioinformatics, and its capabilities include molecular mechanics, support for reading and writing a variety of file formats, protein-ligand scoring, docking, and QSAR modeling.

The Chemistry Development Kit (CDK) \cite{Steinbeck_2006} is a cheminformatics toolkit written in Java.  Its capabilities include support for reading and writing a variety of chemical formats, descriptor and fingerprint calculation, force field calculations, substructure search, and structure generation.

Chem$^f$ \cite{H_ck_2012} is a minimal cheminformatics toolkit written in the functional language Scala.

chemfp \cite{dalke2011chemfp} is a high-performance library with a Python interface for generating and searching for molecular fingerprints. 
 
chemkit is a C++ cheminformatics toolkit that includes support for visualization with the Qt framework and molecular modeling.

ChemmineR \cite{Cao_2008}  is a cheminformatics package for the R statistical programming language that is built using Open Babel. Its capabilities include property calculations, similarity search, and classification and clustering of compounds.

Cinfony \cite{cinfony} provides a single, simple standardized interface to other cheminformatics toolkits, including Open Babel, RDKit, the CDK, Indigo, JChem, OPSIN, and several web services.

CurlySMILES \cite{Drefahl_2011} provides parsing functionality for an extension of the SMILES format that supports the description of complex molecular systems.

DisCuS (Database System for Compound Selection) \cite{W_jcikowski_2014} provides support for analyzing the results of a high-throughput screen.

Fafoom (flexible algorithm for optimization of molecules) \cite{Supady_2015} is a Python library for identifying low energy conformers using a genetic algorithm.

fmcsR \cite{Goecks_2010} is an R package that efficiently performs flexible maximum common substructure matching that allows minor mismatches between atoms and bonds in the common substructure.

Frowns is a cheminformatics toolkit mostly written in Python that provides basic support for SMILES and SD files, SMARTS search, fingerprint generation, and property perception.

Helium is a cheminformatics toolkit written using modern C++ idioms that provides support for SMILES files, fingerprints generation, and SMARTS and SMIRKS.

Indigo \cite{Pavlov_2011} is a cheminformatics toolkit written in C++ with C, Python, Java (including a KNIME node), and C\# bindings.  Its capabilities include general support for manipulating molecules, property calculation, combinatorial chemistry, scaffold detection and R-group decomposition, reaction processing, substructure matching and similarity search.

JOELib is a cheminformatics toolkit written in Java. Its capabilities include SMARTS substructure search, descriptor calculation, and processing/filtering pipes.

LICSS \cite{Lawson_2012} integrates with the CDK to provide representations and analysis of chemical data embedded within Microsoft Excel.

MayChemTools is a collection of Perl scripts for manipulating chemical data, interfacing with databases, generating fingerprints, performing similarity search, and computing molecular properties.

Mychem is built using OpenBabel and provides an extension to the MySQL database package that adds the ability to search, analyze, and convert chemical data within a MySQL database.

The Open Drug Discovery Toolkit (ODDT) \cite{W_jcikowski_2015} is entirely written in Python, is built on top of RDKit and Open Babel, and is focused on providing enhanced functionality for managing and implementing drug discovery workflows, such as making it easy to implement a docking pipeline. 

Open Babel \cite{openbabel} is substantial cheminformatics toolkit written in C++ with Python, Perl, Java, Ruby, R, PHP, and Scala bindings.  Its capabilities include support for more than 100 chemical file formats, fingerprint generation, property determination, similarity and substructure search, structure generation, and molecular force fields.  It has absorbed the Confab \cite{confab} conformer generator which produces 3D structures through the systematic enumeration of torsions and energy minimization.

OPSIN \cite{Lowe_2011}, the Open Parser for Systematic IUPAC nomenclature, converts plain-text chemical nomenclature to machine readable CML or InChi formats.

OrChem is built using the CDK and provides an extension to Oracle databases that adds the ability to incorporate and search chemical data.

OSRA \cite{Filippov_2009} provides optical structure recognition. It takes as input an image and generates a SMILES string.

Ouch (Ouch Uses Chemical Haskell) is a minimal cheminformatics toolkit written in the functional language Haskell.

Pybel \cite{pybel} provides the full functionality of Open Babel, but common routines are provided in a simplified, more `pythonic' interface.

rcdk \cite{guha2007chemical}  provides an R interface to the CDK and working with fingerprints.


RDKit is a substantial cheminformatics toolkit written in C++ with Python, Java and C\# bindings.  Its capabilities include file handling, manipulation of molecular data, chemical reactions, substantial support for fingerprinting, substructure and similarity search, 3D conformer generation, property determination, force field support, shape-based alignment and screening, and integration with PyMOL, KNIME, and PostgreSQL.

RInChI provides tools for creating and manipulating reaction InChIs, a unique string for describing a reaction.

rpubchem is an R package for interfacing with the PubChem database.

rubabel \cite{Smith_2013} is similar to Pybel in that it provides a native Ruby interface to Open Babel.

The Small Molecule Subgraph Detector (SMSD) \cite{Rahman_2009} is a Java library for calculating the maximum common subgraph between small molecules.

Som-it\textsuperscript{TM}  is an R package for creating and visualizing self-organizing maps from large datasets.

webchem is an R package for interfacing with a dozen different on-line resources for chemical data.

\subsection*{Standalone Programs (Table~\ref{standalone})}

cApp \cite{Amani_2015} is a Java application that provides tools for evaluating physico-chemical properties, performing similarity searches, and querying the PubChem database.

The utilities checkmol and matchmol \cite{Haider_2010} decompose and compare functional groups of input molecules.

ConvertMAS is a utility for converting between formats and merging and splitting multi-molecule files.

Filter-it\textsuperscript{TM} filters a set of molecules based on their properties such as physicochemical parameters and graph-based properties. 

Frog2 \cite{Miteva_2010} uses a two stage Monte Carlo approach coupled with energy minimization to rapidly generate 3D conformers.

The Lilly MedChem Rules (LMR)  \cite{Bruns_2012} apply filters to avoid reactive and promiscuous compounds.

Molpher  \cite{Hoksza_2014} generates a virtual chemical library that represents the chemical space between two input molecules as it consists of the path found by morphing one molecule to another.

MoSS (Molecular Subsstructure miner) \cite{Borgelt_2005} finds common molecular substructures and discriminative fragments within a compound library.

The Open Molecule Generator (OMG) \cite{Peironcely_2012} enumerates all possible chemical structures given constraints on their composition.

sdf2xyz2sdf  \cite{Tosco_2011} converts between SDF and TINKER XYZ files.

sdsorter provides convenient routines for manipulating, sorting, and filtering the contents of sdf molecular data files based on the embedded sd data tags.

Shape \cite{Rosen_2009} employs a genetic algorithm to generate conformations of carbohydrates.

Strip-it\textsuperscript{TM} is built using Open Babel and extracts molecular scaffolds. 


\subsection*{Graphical Development Environments (Table~\ref{chemgui})} 

Ambit \cite{Jeliazkova_2011} integrates with the CDK to provide web-based applications for chemical search and analysis and includes a tautomer generation algorithm \cite{Kochev_2013}.

Bioclipse  \cite{Spjuth_2009} is a workbench, based on the Eclipse framework, for manipulating and analyzing biochemical data and databases. It integrates with the CDK and Jmol to provide cheminformatic functionality and also has modules for bioinformatics (primarly sequence analysis) and QSAR modeling.

Galaxy \cite{Goecks_2010} is a web platform for exploring biomedical data and includes as a component a Chemical Toolbox that integrates a number of other cheminformatics tools to offer an array of molecular search, property calculation, clustering, and manipulation capabilities.

The Konstanz Information Miner (KNIME) is a general workflow environment that includes a number of plugins for cheminformatics, such as CDK \cite{Beisken_2013} and RDKit modules, as well as bioinformatics and machine learning modules.

Orange  \cite{JMLR:demsar13a} is a graphical interface for construction interactive workflows and performing data analysis and visualization.

Screening Assistant 2 (SA2) \cite{Guilloux_2012} is a GUI written in Java that integrates with other toolkits to help manage, analyze, and visualize libraries of compounds.

Taverna \cite{Wolstencroft_2013} is a graphical workflow editor that includes support for integrating with web services and the CDK \cite{Kuhn_2010}.

Weka \cite{Hall_2009} is a platform for data mining and machine learning that can be adapted for cheminformatics.  


\section{Visualization}
  
An essential component of any molecular modeling exercise is the ability to visualize and, sometimes, edit molecular data.  Visualization software usually either deals with exclusively 2D or 3D molecular data and may be primarily intended for desktop usage (native `fat' clients) or as a component embedded in a web browser.  Packages designed for visualizing entire datasets are cataloged in the QSAR section (Table~\ref{qsarviz}) and those with a particular emphasize on visualizing the output of quantum chemistry packages are in the Quantum Chemistry section (Table~\ref{qmviz}).\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
BKchem & \url{http://bkchem.zirael.org} & GPL & C3 & \\
chemfig & \url{https://www.ctan.org/pkg/chemfig} & \LaTeX & A2 & \\
Chemtool & \url{http://ruby.chemie.uni-freiburg.de/~martin/chemtool} & GPL & B3 & \\
JChemPaint & \url{http://jchempaint.github.io} & LGPL & B1 & \cite{Krause_2000} \\
LeView & \url{http://www.pegase-biosciences.com/leview-ligand-environment-viewer} & GPL & B3 & \cite{Caboche_2013} \\
mol2chemfig & \url{http://chimpsky.uwaterloo.ca/mol2chemfig} & \LaTeX & C3 & \cite{Brefo_Mensah_2012} \\
Molsketch & \url{http://sourceforge.net/projects/molsketch} & GPL & A1 & \\
SketchEl & \url{http://sketchel.sourceforge.net} & GPL & A1 & \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{2ddesktopviz} Open source tools for 2D molecular visualization and editing on the desktop.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
    Avogadro & \url{http://avogadro.cc} &  GPL & A1 & \cite{Hanwell_2012} \\
    BALLView & \url{http://www.ball-project.org/ballview} & LPGL & A2  & \cite{Moll_2005} \\
    gMol & \url{https://github.com/tjod/gMol/wiki} & GPL & A3 &  \\
    Jamberoo & \url {https://sourceforge.net/projects/jbonzer} & LGPL & A3 & \\
    LPMV & \url{https://sourceforge.net/projects/lpmolecularviewer} & LGPL & B3 & \\
    Luscus & \url{https://sourceforge.net/projects/luscus} &Academic & A1 & \cite{Kova_evi__2015} \\
    Molecular Rift & \url{https://github.com/Magnusnorrby/MolecularRift} & GPL & A3 & \cite{Norrby_2015} \\
    OpenStructure & \url{http://www.openstructure.org} & LGPL & A2 & \cite{Biasini_2013} \\
    PLIP & \url{https://github.com/ssalentin/plip} & Apache & A2 & \cite{Salentin_2015} \\
    PyMOL & \url{https://sourceforge.net/projects/pymol} & Python & A1 &  \\
    RasTop & \url{https://sourceforge.net/projects/rastop} & GPL & C1 &  \\
    OpenRasMol & \url{https://sourceforge.net/projects/openrasmol} & GPL &  C1 & \\
    SPADE & \url{http://www.spadeweb.org} & BSD & C3 & \cite{sweeney2011computational} \\
QuteMol & \url {http://qutemol.sourceforge.net} & GPL & C1 & \cite{Tarini_2006} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{3ddesktopviz} Open source tools for 3D molecular visualization and editing on the desktop.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
3Dmol.js & \url{3dmol.csb.pitt.edu} & BSD & A1 & \cite{Rego_2014} \\
CH5M3D & \url{https://sourceforge.net/projects/ch5m3d} & GPL & C1 & \cite{Earley_2013} \\
Chemozart & \url{https://chemozart.com} & Apache & A1 & \cite{Mohebifar_2015} \\
CWC & \url{https://web.chemdoodle.com} & GPL & A1 & \cite{Burger_2015} \\
JSME & \url{http://peter-ertl.com/jsme} & BSD & A1 & \cite{Bienfait_2013} \\
Jmol & \url{http://jmol.sourceforge.net} & LGPL & A1 & \cite{Hanson_2010}\\
JSmol & \url{https://sourceforge.net/projects/jsmol} & LGPL & A1 & \cite{Hanson_2013} \\
NGL & \url{http://proteinformatics.charite.de/ngl} & MIT & A1 & \cite{Rose_2015} \\
PV & \url{https://biasmv.github.io/pv} & MIT & A1 & \cite{95f13b46-4e83-4cdd-afc0-6de07bca5ae8} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{webviz} Open source tools for web-based molecular visualization.}}
\end{table}

\subsection*{2D Desktop Applications (Table~\ref{2ddesktopviz})}

BKChem is a 2D molecular editor written in python that uses the Tk GUI toolkit.

chemfig is a tool for embedding chemical drawings in {\LaTeX} documents.

Chemtool is a 2D molecular editor for Linux systems that uses the GTK toolkit.

JChemPaint \cite{Krause_2000} is a Java-based 2D molecular editor built using the CDK toolkit.

LeView \cite{Caboche_2013} generates 2D representations of ligand-protein interactions that highlight features such as hydrogen bonds.

mol2chemfig \cite{Brefo_Mensah_2012} converts SMILES files into {\LaTeX} source code.

Molsketch is a 2D molecular editor written in C++ with the Qt toolkit that includes support for the Windows and Android operating systems.

SketchEl is a Java-based 2D molecular editor that includes support for a datasheet view for handling multi-molecule files.

\subsection*{3D Desktop Applications (Table~\ref{3ddesktopviz})}

Avogadro \cite{Hanwell_2012} is a 3D molecular viewer and editor with a modular plugin architecture with both Python and C++ bindings that includes interactive structure optimization for real-time editing. 

BALLView \cite{Moll_2005} provides interactive 3D visualizations as part of the BALL \cite{Hildebrandt_2010} cheminformatics toolkit.

gMol provides basic interactive 3D visualizations of molecular data readable by Open Babel.

Jamberoo provides a basic Java-based 3D molecular viewer and editor.

LP Molecular Viewer is an ActiveX/ATL control for embedding interactive 3D representations of molecular data in Microsoft products.

Luscus \cite{Kova_evi__2015} is a 3D viewer and editor that is designed with a focus on electronic structure information.

Molecular Rift \cite{Norrby_2015} integrates with the Oculus Rift virtual reality headset to provide immersive visualization of 3D molecular data.

OpenStructure \cite{Biasini_2013} is a computational structural biology framework that provides a 3D viewer for manipulating structural information and includes an interactive Python shell.

PLIP (Protein-Ligand Interaction Profiler) \cite{Salentin_2015} runs as a web application and analyzes and visualizes protein-ligand interactions in 3D.

PyMOL is a substantial 3D molecular viewer that includes a full Python interface to support scripting and plugin development.

RasTop and OpenRasMol are based off the venerable RasMol software and provide basic 3D visualization. 

SPADE (Structural Proteomics Application Development Environment) \cite{sweeney2011computational} is a graphical Python interface for structural informatics.

QuteMol \cite{Tarini_2006} provides high-quality, visually engaging renderings of 3D molecular data.


\subsection*{Web-Based Visualization (Table~\ref{webviz})}

3Dmol.js \cite{Rego_2014} is a JavaScript library that provides WebGL-accelerated interactive 3D visualizations of molecular structures and surfaces.

CH5M3D \cite{Earley_2013} uses JavaScript and HTML5 to provide visualization and editing of 3D structures of small molecules.

Chemozart \cite{Mohebifar_2015} is a WebGL-based web application for 3D editing of small molecules.

CWC (ChemDoodle Web Components) \cite{Burger_2015} provides a suite of web-based visualizers and editors for 2D and 3D molecular data.

JSME \cite{Bienfait_2013} is a pure JavaScript 2D molecular editor that can export and import SMILES data.

Jmol \cite{Hanson_2010} is a Java applet for interactive 3D visualization that provides significant cheminformatics support and a custom scripting language.

JSmol \cite{Hanson_2013} is the JavaScript port of Jmol and does not require the Java plugin to run.

NGL \cite{Rose_2015} is a WebGL-accelerated viewer and JavaScript library for interactive 3D visualization of macromolecules.

PV (Protein Viewer) \cite{95f13b46-4e83-4cdd-afc0-6de07bca5ae8} is a WebGL-accelerated viewer for interactive 3D visualization of macromolecules with a functional-style API.






\section{QSAR/ADMET Modeling}
  
Quantitative Structure-Activity Relationship (QSAR) approaches find relationships between the chemical structures of a series of compounds (or structural-related properties) and a biological activity \cite{1995}, including ADMET properties (absorption, distribution, metabolism, excretion, and toxicity).  QSAR methods calculate relevant molecular descriptors, build informative models using these descriptors and then apply the models.  Models and datasets may also be visualized to aid in model development and understanding of compound libraries.  Note that most of the cheminformatics toolkits shown in Table~\ref{chemtool} also are capable of generating descriptors (and are often used as libraries by QSAR modeling software).\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
Name & URL & License & Activity & Citation \\ \hline
     4D-FAP    &\url{http://www.ra.cs.uni-tuebingen.de/software/4DFAP} & LGPL & C2 & \cite{Jahn_2010} \\ 
     BlueDesc & \url{http://www.ra.cs.uni-tuebingen.de/software/bluedesc} & GPL & C3 & \\  
        MolSig & \url{http://molsig.sourceforge.net} & GPL & C2 & \cite{Carbonell_2013}\\  
       PaDEL-descriptor &  \url{http://www.yapcwsoft.com/dd/padeldescriptor} & Public Domain & C1 & \cite{Yap_2010} \\ 
        TMACC &  \url{http://comp.chem.nottingham.ac.uk/download/tmacc} & GPL & C2 & \cite{Melville_2007} \\ 
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{descriptors} Open source software for computing molecular descriptors.}} 
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
AZOrange & \url{https://github.com/AZCompTox/AZOrange} & LGPL & C2 & \cite{St_lring_2011}\\ 
Bioalerts & \url{https://github.com/isidroc/bioalerts} & GPL & A3 & \cite{Cortes_Ciriano_2016} \\
camb & \url{https://github.com/cambDI} & GPL & B2 & \cite{Murrell_2015} \\
eTOXlab & \url{https://github.com/manuelpastor/eTOXlab} & GPL & B3 & \cite{Carri__2015} \\
Open3DGRID &  \url{http://open3dgrid.sourceforge.net} & GPL & B1 & \\ 
 Open3DQSAR &  \url{http://open3dqsar.sourceforge.net} & GPL & B1 & \cite{Tosco_2010}\\
 QSAR-tools &  \url{https://github.com/dkoes/qsar-tools} & BSD & A3 & \\ 
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{qsarmodel} Open source software for building QSAR models.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
SMARTCyp &  \url{http://www.farma.ku.dk/smartcyp} & LGPL & C1 & \cite{Rydberg_2013} \\ 
Toxtree &  \url{http://toxtree.sourceforge.net} & GPL & A1 & \cite{Patlewicz_2008} \\ 
UG-RNN & \url{http://cdb.ics.uci.edu/cgibin/tools/AquaSolWeb.py} & Apache &  C1 & \cite{Lusci_2013} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{qsarapply} Open source software that applies a QSAR model.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
CheS-Mapper &  \url{http://ches-mapper.org} & GPL & A2 & \cite{G_tlein_2014} \\ 
DataWarrior & \url{http://www.openmolecules.org/datawarrior} &  GPL & A1 & \cite{Sander_2015} \\
DecoyFinder & \url{http://urvnutrigenomica-ctns.github.io/DecoyFinder} & GPL & A1 & \cite{Cereto_Massague_2012} \\
Scaffold Hunter & \url{http://scaffoldhunter.sf.net} & GPL & A1 & \cite{Wetzel_2009} \\
Synergy Maps & \url{https://github.com/richlewis42/synergy-maps} & MIT & A2 & \cite{Lewis_2015} \\
VIDEAN &  \url{https://github.com/jimenamartinez/VIDEAN} & BSD & A3 & \cite{Mart_nez_2015} \\ 
WCSE & \url{http://www.cheminfo.org/wikipedia} & BSD & A2 & \cite{Ertl_2015} \\
WebChemViewer & \url{http://sourceforge.net/projects/webchemviewer} & BSD & C3 & \cite{Durrant_2014} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{qsarviz} Open source software for visualizing QSAR models and compound datasets.}}
\end{table}


\subsection*{Descriptor Calculators (Table~\ref{descriptors})}
4D Flexible Atom-Pair Kernel (4D FAP) computes a `4D' similarity measure from the molecular graphs of an ensemble of conformations which can be incorporated into QSAR models.

The BlueDesc descriptor calculator is a command-line tool that converts an MDL SD file into ARFF and LIBSVM format using CDK and JOELib2 for machine learning and data mining purposes. It computes 174 descriptors taken from both libraries.

MolSig \cite{Carbonell_2013} computes molecular graph descriptors that include stereochemistry information.

PaDEL-Descriptor  \cite{Yap_2010} calculates molecular descriptors and fingerprints. It computes 1875 descriptors (1444 1D, 2D descriptors and 431 3D descriptors) and 12 types of fingerprints. 

Topological maximum cross correlation descriptors (TMACC) \cite{Melville_2007} generates 2D autocorrelation descriptors that are low dimensional and interpretable and appropriate for QSAR modeling.

\subsection*{Model Building (Table~\ref{qsarmodel})}
AZOrange \cite{St_lring_2011} is a machine learning package that supports QSAR model building in a full work flow from descriptor computation to automated model building, validation and selection. It promotes model accuracy by using several high performance machine learning algorithms for efficient data set specific selection of the statistical approach.

Bioalerts \cite{Cortes_Ciriano_2016} uses RDKit fingerprints to create models from discrete (e.g., toxic/non-toxic) and continuous data.  It includes the capability to visualize problematic functional groups.

Chemistry aware model builder (camb) \cite{Murrell_2015} is an R package for the generation of quantitative models. Its capabilities include descriptor calculation (including 905 two-dimensional and 14 fingerprint type descriptors for small molecules, 13 whole protein sequence descriptors, and 8 types of amino acid descriptors), model generation, ensemble modeling, and visualization.

eTOXLab \cite{Carri__2015} provides a portable modeling framework embedded in a self-contained virtual machine for easy deployment.

Open3DGrid and Open3DQSAR \cite{Tosco_2010} are a suite of related tools that build 3D QSAR models.  Open3DGrid generates molecular interaction fields (MIFs) in a variety of formats, and Open3DQSAR builds predictive models from the MIFs of aligned molecules.  Calculations can be visualized in real time in PyMOL.

QSAR-tools is a set of Python scripts that use RDKit to build linear QSAR models from 2D chemical data. 

\subsection*{Model Application (Table~\ref{qsarapply})}

SMARTCyp \cite{Rydberg_2010} is a QSAR model that predicts the sites of cytochrome P450-mediated metabolism of drug-like molecules directly from the 2D structure of a molecule using fragment-based energy rules.

Toxtree \cite{Patlewicz_2008} is a Java GUI application for estimating the ``toxic hazard'' of molecules using a variety of toxicity prediction modules, such as oral toxicity, skin  and eye irritation prediction, covalent protein binding and DNA binding, Cytochrome P450-mediated drug metabolism (using SMARTCyp) and more.

UG-RNN/AquaSol \cite{Lusci_2013} is an undirected graph recursive neural network that has been trained to predict aqueous solubility from molecular graphs. 

\subsection*{Visualization (Table~\ref{qsarviz})}
CheS-Mapper (chemical space mapper) \cite{G_tlein_2012,G_tlein_2014}. is a 3D-viewer for small compounds in chemical datasets. It embeds a dataset into 3D space by performing dimensionality reduction on the properties of the compounds.

DataWarrior \cite{Sander_2015} is a data visualization and analysis tool for chemical data with a rich set of available property calculations, similarity metrics, modeling capabilities, and data set representations.

DecoyFinder \cite{Cereto_Massague_2012} provides a GUI for selecting a set of decoy compounds from a large library that are appropriate matches to a given set of actives.

 Scaffold Hunter \cite{Wetzel_2009} provides a Java-based GUI for visualizing the relationship between compounds in a dataset.

Synergy Maps \cite{Lewis_2015} visualizes synergistic activity extracted from screens of drug combinations. 

VIDEAN (visual and interactive descriptor analysis) \cite{Mart_nez_2015} is a visual tool for iteratively choosing a subset of descriptors appropriate for predicting a target property with the aid of statistical methods.  

WCSE (Wikipedia chemical structure explorer) \cite{Ertl_2015} runs as a web application and provides a 2D interface for visualizing and searching for 2D molecules.

WebChemViewer  \cite{Durrant_2014} is an online viewer for viewing and interacting with lists of compounds and their associated data.


\section{Quantum Chemistry}
Quantum mechanics (QM) is increasingly accessible and relevant to molecular modeling and \textit{in silico} drug design \cite{Vivo_2011}. Quantum chemistry models molecules at the level of their wave function and offers enhanced accuracy and detail compared to classical models at a substantial increase in computation time.  Corresponding to the large diversity of solution methods for Schr\"odinger's equation, there are many software packages for \textit{ab initio} quantum chemistry, as well as programs for interpreting and visualizing the results of these calculations.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
ABINIT &\url{http://www.abinit.org} & GPL & A1 & \cite{Gonze_2009} \\
ACES & \url{http://www.qtp.ufl.edu/aces} & GPL & A1 & \cite{Lotrich_2008} \\
BigDFT &\url{http://bigdft.org} & GPL & A1 & \cite{Mohr_2015}\\
CP2K& \url{http://www.cp2k.org}  & GPL & A1 & \cite{Hutter_2013} \\
DACAPO & \url{https://wiki.fysik.dtu.dk/dacapo}  & GPL & C1 &  \cite{Bahn_2002}\\
ErgoSCF & \url{http://www.ergoscf.org}  & GPL & C2 & \cite{Rudberg_2011} \\
ERKALE & \url{https://github.com/susilehtola/erkale}  & GPL & B2 & \cite{Lehtola_2012} \\
GPAW & \url{https://wiki.fysik.dtu.dk/gpaw}  & GPL & A1 & \cite{gpaw} \\
HORTON & \url{http://theochem.github.io/horton}  & GPL & A1& \\
JANPA & \url{http://janpa.sourceforge.net}  &  BSD & A1 &\cite{Nikolaienko_2014} \\
MPQC & \url{http://www.mpqc.org}  & LGPL & B1 & \cite{Janssen95} \\
NWChem & \url{http://www.nwchem-sw.org} & ECL & A1 & \cite{Valiev_2010} \\
Octopus& \url{http://www.tddft.org/programs/octopus} & GPL & A1 & \cite{Andrade_2015}\\
OpenMX& \url{http://www.openmx-square.org}  & GPL & A1 & \cite{Ozaki_2005} \\
Psi4& \url{http://www.psicode.org}  & GPL & A1 & \cite{Turney_2011}\\
pyquante & \url{http://sourceforge.net/projects/pyquante}  & BSD &  A1 & \\
PySCF & \url{https://github.com/sunqm/pyscf}  & BSD & A1 & \\
QMCPACK & \url{http://qmcpack.org}  & BSD & A2 & \cite{kim2010quantum}\\
Quantum espresso & \url{http://www.quantum-espresso.org}  & GPL &  A1 & \cite{Giannozzi_2009}\\
RMG& \url{http://rmgdft.sourceforge.net}  & BSD/GPL & A1 &  \cite{moore2012scaling}\\
SQ& \url{https://sites.google.com/site/siamquantum}  & GPL & A2 & \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{abinitio} Open source quantum chemistry software for performing \textit{ab initio} calculations.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
FragIt & \url{https://github.com/FragIt}  & GPL & A2 & \cite{Steinmann_2012} \\
cclib &\url{https://github.com/cclib/cclib} & LGPL & A1 & \cite{O_boyle_2008}\\
GaussSum & \url{http://sourceforge.net/projects/gausssum}  & GPL & A1 & \cite{O_boyle_2008} \\
Geac & \url{https://github.com/LaTruelle/Geac}  & GPL & A3 & \\
Nancy\_EX & \url{http://sourceforge.net/projects/nancyex}  & GPL & A2 &\cite{Etienne_2014}\\
orbkit& \url{http://orbkit.sourceforge.net}  & GPL & A2 & \cite{hermann2016orbkit} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{qmhelp} Open source software for analyzing the results of quantum chemistry calculations.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
CCP1GUI& \url{http://www.scd.stfc.ac.uk/research/app/40501.aspx}  & GPL & C3 & \\
ccwatcher & \url{http://sourceforge.net/projects/ccwatcher}  & GPL & B2 & \\
Gabedit & \url{http://gabedit.sourceforge.net} & BSD &  C1 & \cite{Allouche_2010} \\
J-ICE & \url{http://j-ice.sourceforge.net} & GPL & A1 & \cite{Canepa_2010} \\
QMForge& \url{http://qmforge.sourceforge.net}  & GPL & A1 & \\
 wxMacMolPlt & \url{http://brettbode.github.io/wxmacmolplt} & GPL & A1 & \cite{Bode_1998} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{qmviz} Open source software for quantum chemistry visualization.}}
\end{table}


\subsection*{\textit{Ab initio} Calcuation (Table~\ref{abinitio})}

ABINIT \cite{Gonze_2009} can calculate the total energy, charge density and electronic structure of molecules and periodic solids with density functional theory (DFT) and Many-Body Perturbation Theory (MBPT), using pseudopotentials and a planewave or wavelet basis. ABINIT also can optimize the geometry, perform molecular dynamics simulations, or generate dynamical matrices, Born effective charges, and dielectric tensors and many more properties. 

ACES \cite{Lotrich_2008} performs calculations such as single point energy calculations, analytical gradients, and analytical Hessians, and is highly parallelized, including support for GPU computing.
A focus of ACES is the use of MBPT and the coupled-cluster approximation to reliable treat electron correlation.

BigDFT \cite{Genovese_2008,Mohr_2014,Mohr_2015} performs \textit{ab initio} calculations using Daubechies wavelets and has the capability to use a linear scaling method.  Periodic systems, surfaces and isolated systems can be simulated with the proper boundary conditions. It is included as part of ABINIT.

CP2K \cite{Hutter_2013} performs simulations of solid state, liquid, molecular and biological systems. Its particular focus is massively parallel and linear scaling electronic structure methods and state-of-the-art \textit{ab-initio} molecular dynamics (AIMD) simulations. It is optimized for the mixed Gaussian and Plane-Waves method using pseudopotentials and can run on parallel and on GPUs.

Dacapo is a total energy program that uses density functional theory. It can do molecular dynamics/structural relaxation while solving the Schr\"odinger equations. It has support for parallel execution and is used through the Atomic Simulation Environment (ASE) \cite{Bahn_2002}

ErgoSCM \cite{Rudberg_2011} is a quantum chemistry program for large-scale self-consistent field calculations. It performs electronic structure calculations using Hartree-Fock and Kohn-Sham density functional theory and achieves linear scaling for both CPU usage and memory utilization.

ERKALE \cite{Lehtola_2012} is designed to compute X-ray properties, such as ground-state electron momentum densities and Compton profiles, and core (x-ray absorption and x-ray Raman scattering) and valence electron excitation spectra of atoms and molecules.

GPAW \cite{gpaw} is a DFT code that uses the projector-augmented wave (PAW) technique \cite{Bl_chl_1994,Kresse_1999} and integrates with the  atomic simulation environment (ASE)  \cite{Bahn_2002}. 

HORTON (Helpful Open-source Research TOol for N-fermion systems) has as a primary design goal ease of extensibility for researching new methods in \textit{ab initio} electronic structure theory.

JANPA \cite{Nikolaienko_2014} computes natural atomic orbitals from a reduced one-particle density matrix.

MPQC (massively parallel quantum chemistry program) \cite{Janssen95} offers many features including closed shell, unrestricted and general restricted open shell Hartree-Fock energies and gradients, closed shell, unrestricted and general restricted open shell density functional theory energies and gradients, second order open shell perturbation theory and Z-averaged perturbation theory energies.

NWChem \cite{Valiev_2010} provides a full suite of methods for modeling both classical and QM systems. Its capabilities include molecular electronic structure, QM/MM, pseudopotential plane-wave electronic structure, and molecular dynamics and is designed to scale across hundreds of processors.

Octopus pervorms \textit{ab initio} calculations using time-dependent DFT (TDDFT) and pseudopotentials.  Included in the project is libxc \cite{Marques_2012} which is a standalone library of exchange-correlation functionals for DFT (released under the LGPL).

OpenMX (Open source package for material eXplorer) \cite{Ozaki_2005} is designed for nano-scale material simulations based on DFT, norm-conserving pseudopotentials, and pseudo-atomic localized basis functions. OpenMX is capable of performing calculations of physical properties such as magnetic, dielectric, and electric transport properties and is optimized for large-scale parallelism.

Psi4 \cite{Turney_2011} is a suite of \textit{ab initio} quantum chemistry programs that supports a wide range of computations (e.g., Hartree--Fock, MP2, coupled-cluster) and general procedures such as geometry optimization and vibrational frequency analysis with more than 2500 basis functions.

PyQuante is a collection of modules, mostly written in Python, for performing Hartree-Fock and DFT calculations with a focus on providing a well-engineered set of tools. A new version is under development (\url{https://github.com/rpmuller/pyquante2}).

PySCF is also written primarily in Python and supports several popular methods such as Hartree-Fock, DFT, and MP2. It also has easy of use and extension as primary design goals.

QMCPACK \cite{kim2010quantum} is a many-body \textit{ab initio} quantum Monte Carlo implementation for computing electronic structure properties of molecular, quasi-2D and solid-state systems. The standard file formats utilized for input and output are in XML and HDF5.

QUANTUM ESPRESSO \cite{Giannozzi_2009} is designed for modeling at the nanoscale using DFT, plane waves, and pseudopotentials and its capabilities include ground-state calculations, structural optimization, transition states and minimum energy paths, \textit{ab initio} molecular dynamics, DFT perturbation theory, spectroscopic properties, and quantum transport.

RMG \cite{moore2012scaling} is a DFT code that uses real space grids to provide high scalability across thousands of processors and GPU acceleration for both structural relaxation and molecular dynamics.

Siam Quantum (SQ) is optimized for parallel computation and its capabilities include the calculation of Hartree-Fock and MP2 energies, minimum energy crossing point calculations, geometry optimization, population analysis, and quantum molecular dynamics.


\subsection*{Helper Applications (Table~\ref{qmhelp})}
FragIt \cite{Steinmann_2012} generates fragments of large molecules to use as input files in quantum chemistry programs that support fragment based methods.

cclib \cite{O_boyle_2008} provides a consistent interface for parsing and interpreting the results of a number of quantum chemistry packages. 

GaussSum \cite{O_boyle_2008} uses cclib to extract useful information from the results of quantum chemistry programs (ADF, GAMESS, Gaussian, Jaguar) including monitoring the progress of geometry optimization, the UV/IR/Raman spectra, molecular orbital (MO) levels and MO contributions.

Geac (Gaussian ESI Automated Creator) extracts data from Gaussian log files. 

Nancy\_EX \cite{Etienne_2014} post-processes Gaussian output and analyzes excited states including natural transition orbitals, detachment and attachment density matrices, and charge-transfer descriptors.

orbkit \cite{hermann2016orbkit} is a post-processing tool for the results of quantum chemistry programs.  It has native support for a number of programs (MOLPRO, TURBOMOLE, GAMESS-US, PROAIMS/AIMPAC, Gaussian) and additionally interfaces with cclib for additional file format support.  It can extract grid-based quantities such as molecular orbitals and electron density, as well as Muliken population charges and other properties.


\subsection*{Visualization (Table~\ref{qmviz})}
CCP1GUI provides a graphical user interface to various computational chemistry codes with an emphasis on integration with the GAMESS-UK quantum chemistry program.

ccwatcher provides a graphical interface for the monitoring of computational chemistry programs.

Gabedit \cite{Allouche_2010} is a graphical user interface to a large number of quantum chemistry packages. It can create input files and graphically visualize calculation results.

J-ICE \cite{Canepa_2010} is a Jmol-based viewer for crystallographic and electronic properties that can be deployed as a Java applet embedded in a web browser.
 
QMForge provides a graphical user interface for analyzing and visualizing results of quantum chemistry DFT calculations (Gaussian, ADF, GAMESS, Jaguar, NWChem, ORCA, QChem).  Analyses include a number of population analyses, Mayer's bond order, charge decomposition, and fragment analysis.

wxMacMolPlt \cite{Bode_1998} is a multi-platform GUI for setting up and visualizing input and output files for the GAMESS quantum chemistry software.

\section{Ligand Dynamics and Free Energy Calculations}
  
Simulation based approaches for analyzing ligand-protein interactions have the potential to fully account for the dynamics of the ligand, protein, and water system.  Molecular dynamics simulation is a powerful tool for computing free energies as long as the system can be properly parameterized and the simulation code adapted and analyzed to implement the desired free energy method.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
Campari & \url{http://campari.sourceforge.net} & GPL & B1 & \cite{Vitalis_2009} \\
DL\_POLY Classic & \url{http://www.ccp5.ac.uk/DL\_POLY\_CLASSIC/} & BSD & C3 & \cite{Smith_2002} \\
GALAMOST & \url{http://galamost.ciac.jl.cn} & GPL & A2 & \cite{Zhu_2013} \\
Gromacs & \url{http://www.gromacs.org} & LGPL & A1 & \cite{Pronk_2013} \\
Iphigenie & \url{https://sourceforge.net/projects/iphigenie} & GPL & A2 & \cite{Lorenzen_2012} \\
LAMMPS & \url{http://lammps.sandia.gov} & GPL & A1 & \cite{Plimpton_1995} \\
MDynaMix & \url {http://www.fos.su.se/~sasha/mdynamix} & GPL & A1 & \cite{Lyubartsev_2000} \\
MMTK & \url{http://dirac.cnrs-orleans.fr/MMTK} & CeCILL & C1 & \cite{Hinsen_2000} \\
OpenMM & \url{https://simtk.org/home/openmm} & GPL/MIT & A1 & \cite{Eastman_2013} \\
ProtoMol & \url{http://protomol.sourceforge.net} & GPL & C1 & \cite{Matthey_2004} \\
ProtoMS & \url{http://www.essexgroup.soton.ac.uk/ProtoMS} & GPL & A2 & \cite{Michel_2006} \\
Sire & \url{http://siremol.org} & GPL & C2 & \\
WESTPA & \url{https://westpa.github.io/westpa} & GPL & A2 & \cite{Zwier_2015} \\
yank & \url{http://getyank.org} & LGPL & A2 & \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{mdtable} Open source software for performing molecular simulations.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
AmberTools & \url{http://ambermd.org} & GPL & A1 & \cite{Salomon_Ferrer_2012} \\
LOOS & \url{http://loos.sourceforge.net} & GPL & A1 & \cite{Romo_2014} \\
lsfitpar & \url{http://mackerell.umaryland.edu/~kenno/lsfitpar} & GPL & A2 & \cite{Vanommeslaeghe_2015} \\
MDAnalysis & \url{http://mdanalysis.org} & GPL & A1 & \cite{Michaud_Agrawal_2011} \\
MDTraj & \url{mdtraj.org} & LGPL & A1 & \cite{McGibbon_2015} \\
MEMBPLUGIN & \url {https://sourceforge.net/projects/membplugin} & GPL & C1 & \cite{Guixa-Gonzalez_2014} \\
MEPSA & \url{http://bioweb.cbm.uam.es/software/MEPSA} & GPL & A3 & \cite{Marcos_Alcalde_2015} \\
MSMBuilder & \url{http://msmbuilder.org} & LGPL & A1 & \cite{Beauchamp_2011} \\
packmol & \url{http://www.ime.unicamp.br/~martinez/packmol} & GPL & A1 & \cite{Mart_nez_2009} \\
PDB2PQR & \url{http://www.poissonboltzmann.org} & BSD & A1 & \cite{Dolinsky_2007} \\
PLUMED & \url{http://www.plumed.org} & LGPL & A1 & \cite{Tribello_2014} \\
ProDy & \url{http://prody.csb.pitt.edu} & MIT & A1 & \cite{Bakan_2011} \\
Pteros & \url{http://pteros.sourceforge.net} & Artistic & B2 & \cite{Yesylevskyy_2015} \\
PyEMMA & \url{http://www.emma-project.org} & LGPL & A1 & \cite{Scherer_2015} \\
PyRED & \url{http://upjv.q4md-forcefieldtools.org} & GPL & C1 & \cite{Dupradeau_2010} \\
PYTRAJ & \url{https://github.com/Amber-MD/pytraj} & GPL & A1 & \\
simpletraj & \url{https://github.com/arose/simpletraj} & GPL & A2 & \\
WHAM & \url{http://membrane.urmc.rochester.edu/content/wham} & BSD & C1 \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{mdanalysis} Open source software for setting up and analyzing molecular simulations.}}
\end{table}

\subsection*{Simulation Software (Table~\ref{mdtable})}

Campari \cite{Vitalis_2009} conducts flexible Monte Carlo sampling of biopolymers in internal coordinate space, with built-in analysis routines to estimate structural properties and support for replica exchange and Wang-Landau sampling.

DL\_POLY Classic \cite{Smith_2002} is a general purpose molecular dynamics simulation package that can run in parallel and includes a Java graphical user interface.

GALAMOST (GPU accelerated large-scale molecular simulation toolkit) \cite{Zhu_2013} uses GPU computing to perform traditional molecular dynamics with a special focus on polymeric systems at mesoscopic scales.

Gromacs \cite{Pronk_2013} is a complete and well-established package for molecular dynamics simulations that provides high performance on both CPUs and GPUs.  It can be used for free energy and QM/MM calculations and includes a comprehensive set of analysis tools.

Iphigenie \cite{Lorenzen_2012} is a molecular mechanics program that features polarizable force fields, the HADES reaction field, and QM/(P)MM hybrid simulations.

LAMMPS  (Large-scale Atomic/Molecular Massively Parallel Simulator) \cite{Plimpton_1995} is a highly modular classical molecular dynamics simulator that includes a diverse array of energy potentials and integrators.

MDynaMix \cite{Lyubartsev_2000} is a basic general purpose molecular dynamics package.

MMTK (Molecular Modelling Toolkit) \cite{Hinsen_2000} is a library written in Python (with some time critical parts written in C) for constructing and simulating molecular systems.  Its capabilities include molecular dynamics, energy minimization, and normal mode analysis and it is well-suited for methods development.

OpenMM  \cite{Eastman_2013} is a substantial toolkit for high performance molecular dynamics simulations that includes support for GPU acceleration.

ProtoMol \cite{Matthey_2004}, and the associated MDLab Python bindings \cite{Cickovski_2009}, provides an object-oriented framework for prototyping algorithms for molecular dynamics simulations and includes an interface to OpenMM.

ProtoMS \cite{Michel_2006} is a Monte Carlo biomolecular simulation program which can be used to calculate relative and absolute free energies and water placement with the GCMC and JAWS methodologies.

Sire is a collection of modular libraries intended to facilitate fast prototyping and the development of new algorithms for molecular simulation and molecular design. It has apps for system setup, simulation, and analysis.

WESTPA  (The Weighted Ensemble Simulation Toolkit with Parallelization and Analysis) \cite{Zwier_2015} is a library for performing weighted ensemble simulations to sample rare events and compute rigorous kinetics.

yank is built off of OpenMM and provides a Python interface for performing alchemical free energy calculations.

\subsection*{Simulation Setup and Analysis (Table~\ref{mdanalysis})}
AmberTools \cite{Salomon_Ferrer_2012} is an open source component of the non-open source Amber package and provides a large suite of analysis programs. As of Amber15, AmberTools includes the lower performance, but readily extendable,  sander molecular dynamics code.

LOOS (Lightweight Object-Oriented Structure library) \cite{Romo_2014} is a C++ library (with Python bindings) for reading and analyzing molecular dynamics trajectories that also includes a number of standalone programs.

lsfitpar \cite{Vanommeslaeghe_2015} derives bonded parameters for Class I force fields by performing a robust fit to potential energy scans provided by the user.

MDAnalysis  \cite{Michaud_Agrawal_2011} is a Python library for reading and analyzing molecular dynamics simulations with some time critical sections written in C.

MDTraj \cite{McGibbon_2015} provides high-performance reading, writing, and analysis of molecular dynamics trajectories in a diversity of formats from a Python interface.

MEMBPLUGIN \cite{Guixa-Gonzalez_2014} analyzes molecular dynamics simulations of lipid bilayers and is most commonly used as a VMD plugin.

MEPSA (Minimum Energy Pathway Analysis) \cite{Marcos_Alcalde_2015} provides tools for analyzing energy landscapes and pathways.

MSMBuilder \cite{Beauchamp_2011} is an application and Python library for building Markov models of high-dimensional trajectory data.

packmol \cite{Mart_nez_2009} is a utility for setting molecular systems  by realistically packing molecules to obey a variety of constraints and can create solvent mixtures and lipid bilayers.

PDB2PQR \cite{Dolinsky_2007} prepares structures for electrostatics calculations by adding hydrogens, calculating sidechain pKa, adding missing heavy atoms, and assigning force field-dependent parameters; users can specify an ambient pH.

PLUMED \cite{Tribello_2014} interfaces with an assortment of molecular dynamics software packages to provide a unified interface for performing free energy calculations using methods such as metadynamics, umbrella sampling and steered MD (Jarzynski).

ProDy \cite{Bakan_2011} is a Python toolkit for analyzing proteins and includes facilities for trajectory analysis and druggability predictions using simulations of molecular probes \cite{Bakan_2012}.

Pteros \cite{Yesylevskyy_2015} is a C++ library (with Python bindings) for reading and analyzing molecular dynamics trajectories.

PyEMMA \cite{Scherer_2015} is a Python library for performing kinetic and thermodynamic analyses of molecular dynamics simulations using Markov models. 

PyRED \cite{Dupradeau_2010} generates RESP and ESP charges for the AMBER, CHARMM, OPLS, and Glycam and force fields.

PYTRAJ is a Python interface to the \texttt{cpptraj} tool of AmberTools.

simpletraj is a lightweight Python library for parsing molecular dynamics trajectories.

WHAM (Weighted Histogram Analysis Method) calculates the potential of mean force (PMF) from umbrella sampling simulations.


\section{Virtual Screening and Ligand Design}

The goal of virtual, or \textit{in silico}, screening is to computationally identify small molecules in a compound library that are active against a given target.  Virtual screening methods usually adopt either a ligand-based approach, where properties of known active compounds are used to identify additional compounds, or a structure-based approach, where the interactions between putative ligands and the receptor structure are used.  Tools for chemical similarity, which can be used for ligand-based screening, are cataloged in the Cheminformatics section.

In contrast to virtual screening, which evaluates predetermined compounds, \textit{de novo} ligand design attempts to create a molecule `from scratch' that binds to a protein.  Methods differ in how they specify the objective to optimize (e.g., docking score to a protein) and how candidate molecules are created, where a key challenge is maintaining synthetic accessibility.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
ACPC & \url{https://github.com/UnixJunkie/ACPC} & BSD & B2 & \cite{Berenger_2014} \\
Align-it & \url{http://silicos-it.be} & LGPL & C3 & \\
 Open3DALIGN &  \url{http://open3dalign.sourceforge.net} & GPL & B2 & \cite{Tosco_2011}\\ 
 PAPER & \url{https://simtk.org/home/paper} & GPL & C2 & \cite{Haque_2010} \\
 Pharmer & \url{http://pharmer.sf.net} & GPL & B1 & \cite{Koes_2011} \\
Pharmit & \url{http://pharmit.sf.net} & GPL & A3 & \cite{Sunseri_2016} \\
Shape-it & \url{http://silicos-it.be} & LGPL & C3 & \\
USRCAT & \url{https://bitbucket.org/aschreyer/usrcat} & MIT & C2 & \cite{Schreyer_2012} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{ligandtable} Open source software for ligand-based virtual screening.}}
\end{table}

\subsection*{Ligand-Based (Table~\ref{ligandtable})}

ACPC (AutoCorrelation of Partial Charges) \cite{Berenger_2014} computes ligand similarity based on a rotation and translation invariant electrostatic descriptor.

Align-it\textsuperscript{TM} is a successor of Pharao \cite{Taminau_2008} and aligns and scores 3D representations of molecules based on their pharmacophore features.  It includes a plugin for integration with PyMOL.

Open3DALIGN \cite{Tosco_2011} performs unsupervised rigid-body molecular alignment.

PAPER \cite{Haque_2010} performs GPU accelerated alignment of molecular shapes using Gaussian overlays.

Pharmer \cite{Koes_2011} uses efficient data structures to rapidly screen large libraries for ligand conformations that match a pharmacophore.

Pharmit \cite{Sunseri_2016} is a successor of Pharmer that also incorporates shape matching and energy minimization (if a receptor structure is available) as part of the screen.  It is primarily intended to be used as a backend to a web service.

Shape-it\textsuperscript{TM} uses Gaussian volumes to align and score molecular shapes.

USRCAT \cite{Schreyer_2012} performs ``ultra-fast shape recognition'' with the addition of pharmacophoric information to rapidly screen compound libraries for similar molecules.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
ADplugin & \url{https://github.com/ADplugin} & LGPL & A2 &\\
APBS & \url{http://www.poissonboltzmann.org} & BSD & A1 & \cite{Baker_2001} \\
AutoDock & \url{http://autodock.scripps.edu} & GPL & C1 & \cite{Morris_2009}\\
AutoDock Vina &\url{http://vina.scripps.edu} & Apache & C1 & \cite{Trott_2009}\\
Clusterizer-DockAccessor & \url{http://cheminf.com/software/clusterizer\_dockaccessor} & GPL & A3 & \cite{Ballante_2016} \\
DockoMatic & \url{https://sourceforge.net/projects/dockomatic} & LGPL & B1 & \cite{Bullock_2013}\\
DOVIS & \url{http://bhsai.org/software} & GPL & C2 & \cite{Jiang_2008}\\
idock & \url{https://github.com/HongjianLi/idock} & Apache & A2 & \cite{Li_2012} \\
MOLA& \url{http://www.esa.ipb.pt/~ruiabreu/mola} & GPL & C2 & \cite{Abreu_2010}\\
NNScore & \url{http://nbcr.ucsd.edu/data/sw/hosted/nnscore} & GPL & C1 & \cite{Durrant_2011} \\
Paradocks & \url{https://github.com/cbaldauf/paradocks} & GPL & A2 & \cite{Meier_2010} \\
PyRx& \url{http://pyrx.sourceforge.net} & BSD & A1 & \cite{Dallakyan_2014} \\
rDock& \url{http://rdock.sourceforge.net} & LGPL & C1 & \cite{Ruiz_Carmona_2014} \\
RF-Score & \url{https://github.com/HongjianLi/RF-Score} & Apache & A2 & \cite{Li_2015} \\
smina & \url{https://sourceforge.net/projects/smina} & GPL & A1 & \cite{Koes_2013} \\
VHELIBS & \url{http://urvnutrigenomica-ctns.github.io/VHELIBS} & GPL & A2 & \cite{Cereto_Massagu__2013} \\
VinaLC& \url{http://mvirdb1.llnl.gov/static\_catsid/vina} & Apache & C2 & \cite{Zhang_2013}\\
VinaMPI & \url{http://cmb.ornl.gov/~sek} & Apache & C2 & \cite{Ellingson_2013} \\
Zodiac & \url{https://sourceforge.net/projects/zodiac-zeden} & GPL & C1 & \cite{Zonta_2008} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{structable} Open source software for molecular docking and scoring.}}
\end{table}\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
eFindSite & \url{http://brylinski.cct.lsu.edu/efindsite} & GPL & C2 & \cite{Brylinski_2013} \\
fpocket & \url{http://fpocket.sourceforge.net} & GPL & C1 & \cite{Schmidtke_2011} \\
HOLLOW & \url{http://hollow.sourceforge.net/} & GPL & C1 & \cite{Ho_2008} \\
KVFinder & \url{http://lnbio.cnpem.br/facilities/bioinformatics/software-2} & GPL & B1 & \cite{Oliveira_2014} \\
mcvol & \url{http://www.bisb.uni-bayreuth.de/data/mcvol/mcvol.html} & GPL & C2 & \cite{Till_2009} \\
PAPCA & \url{https://sourceforge.net/projects/papca} & BSD & C2 & \\
PCS & \url{https://sourceforge.net/projects/cavity-search} & GPL & C2 & \\
PocketPicker & \url{http://gecco.org.chemie.uni-frankfurt.de/pocketpicker} & BSD & C1 & \cite{Weisel_2007} \\
POVME & \url{https://sourceforge.net/projects/povme} & GPL  & C1 & \cite{Durrant_2014} \\
    \end{tabular} 
\iflatexml\else
}
\fi
        \caption{{\label{pockettable} Open source software for pocket detection.}}
\end{table}

\subsection*{Docking and Scoring (Table~\ref{structable})}

ADplugin is a plugin for PyMOL for interfacing with AutoDock and AutoDock Vina.

APBS \cite{Baker_2001} performs solvation free energy calculations using the Poisson-Boltzmann implicit solvent method.

AutoDock \cite{Morris_2009} is an automated docking program that uses a physics-based semiempirical scoring function \cite{Huey_2007} mapped to atom type grids to evaluate poses and a genetic algorithm to explore the conformational space.  It includes the ability to incorporate sidechain flexibility and covalent docking.

AutoDock Vina \cite{Trott_2009} is an entirely separate code base and approach from Autodock that was developed with a focus on runtime performance and ease of system setup. It uses a fully empirical scoring function and an iterated local search global optimizer to produce docked poses. It includes support for multi-threading and flexible sidechains.

Clusterizer-DockAccessor \cite{Ballante_2016} are tools for accessing the quality of docking protocols. It interfaces with a number of open source and free tools.

DockoMatic \cite{Bullock_2013}  provides a graphical user interface for setting up and analyzing AutoDock and AutoDock Vina docking jobs, including when run on a cluster. It also includes the ability to run inverse virtual screens (find proteins that bind a given ligand) and support for homology model construction.

DOVIS \cite{Jiang_2008} is an extension of AutoDock 4.0 that provides more efficient parallelization of large virtual screening jobs.

idock \cite{Li_2012} is a multi-threaded docking program that includes support for the AutoDock Vina scoring function and a random forest scoring function. I can output per-atom free energy information for hotspot detection.

MOLA \cite{Abreu_2010} is a pre-packaged distribution of AutoDock and AutoDock Vina for deployment on multi-platform computing clusters.

NNScore \cite{Durrant_2011} uses a neural network model to score protein-ligand poses.

Paradocks \cite{Meier_2010} is a parallelized docking program that includes a number of population-based metaheuristics, such as particle swarm optimization, for exploring the space of potential poses.

PyRx \cite{Dallakyan_2014} is a visual interface for AutoDock and AutoDock Vina that simplifies setting up and analyzing docking workflows.  Its future as an open-source solution is in doubt due to a recent shift to commercialization.

rDock \cite{Ruiz_Carmona_2014}  is designed for docking against proteins or nucleic acids and can incorporate user-specified constraints. It uses an empirical scoring function that includes solvent accessible surface area terms. A combination of genetic algorithms, Monte Carlo, and simplex minimization is used to explore the conformational space. Distinct scoring functions are provided for docking to proteins and nucleic acids.

RF-Score \cite{Li_2015,Ballester_2010} uses a random forest classifier to score protein-ligand poses.

smina \cite{Koes_2013} is a fork of AutoDock Vina designed to better support energy minimization and custom scoring function development (scoring function terms and atom type properties can be specified using a run-time configuration file). It also simplifies the process of setting up a docking run with flexible sidechains.

VHELIBS (Validation HElper for LIgands and Binding Sites) \cite{Cereto_Massagu__2013} assists the non-crystallographer in validating ligand geometries with respect to electron density maps.

VinaLC  \cite{Zhang_2013} is a fork of AutoDock Vina designed to run on a cluster of multiprocessor machines.

VinaMPI \cite{Ellingson_2013} is a wrapper for AutoDock Vina that uses OpenMPI to run large-scale virtual screens on a computing cluster.

Zodiac \cite{Zonta_2008} is a visual interface for structure-based drug design that includes support for haptic feedback.

\subsection*{Pocket Detection (Table~\ref{pockettable})}
eFindSite \cite{Brylinski_2013} using homology modeling and machine learning predicts ligand binding sites in a protein structure.

fpocket  \cite{Schmidtke_2011} detects and delineates protein cavities using Voronoi tessellation and is able to process molecular dynamics simulations.

HOLLOW \cite{Ho_2008} interfaces with PyMOL to produce clean visualizations of pockets and channels.

KVFinder \cite{Oliveira_2014} is a PyMOL plugin for identifying and characterizing pockets.

mcvol \cite{Till_2009} calculates protein volumes and identifying cavities using a Monte Carlo algorithm.

PAPCA (PocketAnalyzerPCA) is a pocket detection utility designed to analyze ensembles of protein conformations.

PCS (Pocket Cavity Search) measures the volume of internal cavities and evaluates the environment of ionizable residues.

PocketPicker \cite{Weisel_2007}  is a PyMOL plugin that automatically identifies potential ligand binding sites using a grid-based shape descriptor.

POVME (POcket Volume MEasurer) \cite{Durrant_2014} is a tool for measuring and characterizing pocket volumes that includes a graphical user interface.\selectlanguage{english}
\begin{table} 
\footnotesize
\iflatexml\else
\resizebox{\linewidth}{!}{
\fi
    \begin{tabular}{ l p{3.5in} c c c  }
    Name & URL & License & Activity & Citation \\ \hline
AutoClickChem & \url{https://sourceforge.net/projects/autoclickchem} & GPL & C2 & \cite{Durrant_2012} \\
AutoGrow & \url{http://autogrow.ucsd.edu} & GPL & A1 & \cite{Durrant_2013}\\
igrow & \url{https://github.com/HongjianLi/igrow} & Apache & A3 & \\
OpenGrowth & \url{http://opengrowth.sf.net} & GPL & A1 & \cite{Ch_ron_2015} \\
    \end{tabular} 
\iflatexml\else
}
\fi
    \caption{{\label{denovotable} Open source software for ligand design.}}
\end{table}

\subsection*{Ligand Design}

AutoClickChem \cite{Durrant_2012} performs \textit{in silico} click chemistry to generate large libraries of synthetically accessible compounds.

AutoGrow \cite{Durrant_2013} uses a genetic algorithm to explore the space of reactants and reactions accessible via AutoClickChem and identifies compounds that dock well using AutoDock Vina.

igrow, like AutoGrow, uses a genetic algorithm but transforms ligands using branch exchange and uses idock as the underlying docking evaluation protocol.

OpenGrowth  \cite{Ch_ron_2015}  assembles candidate ligands by connecting small organic fragments in the active site of proteins.  It includes a graphical user interface.



\section{Discussion}\selectlanguage{english}
\begin{figure}
\centering 
\includegraphics[width=.5\linewidth]{../licenses}
\caption{{\label{licenses} Distribution of open source licenses used in cataloged software packages.}}
\end{figure}\selectlanguage{english}
\begin{figure*}
\centering
\begin{subfigure}[t]{.4\linewidth}
\centering 
\includegraphics[width=\linewidth]{../develop}
\caption{{\label{develop}}}
\end{subfigure}
\hfill
\begin{subfigure}[t]{.4\linewidth}
\centering 
\includegraphics[width=\linewidth]{../usage}
\caption{{\label{usage}}}
\end{subfigure}
\caption{{\label{pies} Activity distributions of cataloged software packages.
(\subref{develop}) Distribution of development activity. (\subref{usage}) Distribution of user activity.
}}
\end{figure*}\selectlanguage{english}
\begin{figure}
\centering 
\includegraphics[width=.5\linewidth]{../citedist}
\caption{{\label{cites} Distribution of citations as reported by Google Scholar generated on average every year by those software packages with citeable publications.}}
\end{figure}


We have cataloged over 200 open-source packages for molecular modeling that provide a wide range of capabilities.  As shown in Figure~\ref{licenses}, the most popular license (55\%) is some variant of the copyleft GNU Public License, which ensures that derivative works remain open source.  Interestingly 78\% of the packages cataloged have a corresponding citeable publication which suggests that much of the software originates from academia.   The distribution of average citations generated a year (as reported by Google Scholar) for the citeable publications is shown in Figure~\ref{cites}.  A significant majority (84\%) of publications generate at least one citation a year, 29\% generate at least 10 citations, and 8\% generate more than 100 citations a year on average.

A substantial portion of the packages cataloged are under active development and see significant usage, as shown in Figure~\ref{pies}.  We rated 56\% of the packages as `A' level development, meaning major features or releases were made within the last 18 months, and 51\% see substantial usage (rank 1).  
There are a number of projects (30\%) where development has apparently ceased (no changes within the last 18 months). Note that our methodology for identifying packages 
ignores cases where software is no longer available, this is an underestimate.
 However, although we did find instances where an open source package was referenced in a paper but was no longer available, we did not find this to be a common occurrence.  Most packages, even those that have remained unchanged for a decade, see some usage.  In fact, a number of packages (23), still see significant usage despite having received no development for the past 18 months.  This underlies the importance of releasing source code through a third-party site such as SourceForge or GitHub as it ensures the continued existence of a project.  
 
 A major advantage of open source is that in cases where a popular project is not being actively developed (e.g. AutoDock Vina \cite{Trott_2009}) new projects can fork the source code and continue development (e.g. smina \cite{Koes_2013}).  However, a potential problem area with open source development is the lack of central coordination and efficient pooling of resources.  For example, there are several forks of AutoDock Vina that improve it's performance on computing clusters and there are an array of tools in several categories that effectively perform the same task.  This underscores the importance of efforts like Blue Obelisk \cite{Guha_2006,blueobelisk} and Open Chemistry (\url{http://www.openchemistry.org}) which foster collaboration among open source cheminformatics projects.

It is clear that open source software plays an important role in the scientific community and is a vibrant sub-community of its own with a wide assortment of projects under development and in widespread use.  The open source software packages cataloged here provide launching points for the development of new tools for enabling further scientific discovery.


\subsection*{Acknowledgements}
We are grateful to Twitter users @DrBostrom,
@KirkD\_CO,
@wojcikowskim,
@egonwillighagen,
@macinchem,
@rguha,
@ghutchis,
@janhjensen,
@rmcgibbo, 
@synapticarbors, and
@khinsen 
for their helpful feedback on a draft of this manuscript.
This work was supported by the National Institute of Health [R01GM108340].

\selectlanguage{english}
\FloatBarrier
\bibliographystyle{plain}
\bibliography{bibliography/converted_to_latex.bib%
}

\end{CJK}\end{document}

