数据工具

语言 Chinese, Simplified

72 次浏览

SEO Title

Data tools

【ETL工具】精选的ETL（提取，转换，加载）框架，库和软件的精选列表。

语言 Chinese, Simplified

awesome-etl

A curated list of notable ETL (extract, transform, load) frameworks, libraries and software.

Awesome ETL

Related Lists

awesome-pipeline

Workflow Management/Engines

Airflow - "Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed."
Azkaban - "a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows."
Dray.it - "Docker workflow engine. Allows users to separate a workflow into discrete steps each to be handled by a single container."
Luigi - "a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in."
Mara - "A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow"
Pinball - "a scalable workflow management platform developed at Pinterest. It is built based on layered approach."
TaskFlow - "allows the creation of lightweight task objects and/or functions that are combined together into flows (aka: workflows) in a declarative manner. It includes engines for running these flows in a manner that can be stopped, resumed, and safely reverted."
Toil - Similar to Luigi, jobs are classes with a run method. Supports executing jobs on other machines (workers) which can include AWS spot instances.

Job Scheduling

Chronos - "a distributed and fault-tolerant scheduler that runs on top of Apache Mesos that can be used for job orchestration."
Dagobah - "a simple dependency-based job scheduler written in Python. Dagobah allows you to schedule periodic jobs using Cron syntax. Each job then kicks off a series of tasks (subprocesses) in an order defined by a dependency graph you can easily draw with click-and-drag in the web interface."
Jenkins - "the leading open-source automation server. Built with Java, it provides over 1000 plugins to support automating virtually anything, so that humans can actually spend their time doing things machines cannot."

Java

GETL - Groovy toolbox for ETL Tasks from practicing architectures
JSR 352 - Java native API for batch processing
Scriptella - Java-XML ETL toolbox for every day use.
Spring Batch - ETL on Spring ecosystem

Python

Libraries

BeautifulSoup - Popular library used to extract data from web pages.
Blaze - "translates a subset of modified NumPy and Pandas-like syntax to databases and other computing systems."
Bonobo - Simple, modern and atomic data transformation graphs for Python 3.5+.
Bubbles - "a Python ETL Framework and set of tools. It can be used for processing, auditing and inspecting data. Focus is on understandability and transparency of the process."
Celery - "an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well."
Dask - Ever tried using Pandas to process data that won't fit into memory? Dask makes it easy. Dask also has functionality to make it easy to processing continuous streams of data.
dataset - A wrapper around SQLAlchemy that simplifies database operations (including upserting).
ijson - Allows processing JSON iteratively (as a stream) without loading the whole file into memory at once.
Joblib - "a set of tools to provide lightweight pipelining in Python."
lxml - Parses XML using C libraries libxml2 and libxslt, so it's very fast. Also supports a "recover" mode that will try its best to use invalid xml or discard it. Great for large XML files and advanced functionality (like using xpaths). IBM also has a great article on high-performance parsing with lxml here: http://www.ibm.com/developerworks/library/x-hiperfparse/
MrJob - "lets you write MapReduce jobs in Python 2.6+ and run them on several platforms. The easiest route to writing Python programs that run on Hadoop."
Odo - Moves data across containers (SQL, CSV, MongoDB, Pandas, etc). Claims to be the easiest and fastest way to load a CSV into your database.
Pandas - Implements dataframes in Python for easier data processing and includes a number of tools that make it easier to extract data from multiple file formats.
parse - The opposite of Python's format(). Easier to use than regex, but more limited.
PETL - "a general purpose Python package for extracting, transforming and loading tables of data." Slower than Pandas and not as good for larger amounts of data, but simpler.
PyQuery - Extracts data from web pages with a jquery-like syntax.
Retrying - Allows you to add a decorator to any function/method to retry on an exception.
Requests-HTML - Combines PyQuery, Requests, parse, and other libraries for a pleasant and intuitive web scraping experience.
riko - A python stream processing engine modeled after Yahoo! Pipes.
Ruffus - "The Ruffus module is a lightweight way to add support for running computational pipelines."
SQLAlchemy - "the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL."
Toolz - "A functional standard library for python." Includes a pipe function that allows you to pipe a value through a sequence of functions. There's also a cython implementation here: https://github.com/pytoolz/cytoolz
xmltodict - Makes working with XML as easy as working with JSON. Also allows streaming so you don't run out of memory on large XML files. Great for simple operations on small XML files.

Talks/Articles

Ruby

Kiba - "Data processing & ETL framework for Ruby"
nokogiri - an excellent XML parser that "just works"
Square ETL
Sequel - "The Database Toolkit for Ruby"
Embulk - "a parallel bulk data loader that helps data transfer between various storages, databases, NoSQL and cloud services."

Go

Crunch - "A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop."
Pachyderm - A system for running processing pipeline jobs in containers and version controlling all data using a commit-based distributed filesystem.

Javascript

Datapumps - "Use pumps to import, export, transform or transfer data."
NoFlo - "a JavaScript implementation of Flow-Based Programming"

Talks/Articles

Cloud Services

Alteryx - Cloud ETL tool with an interface similar to GUI ETL tools.
AWS Data Pipeline - "a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premise data sources, at specified intervals."
AWS Glue - AWS Glue generates the code (using Python and Spark) to execute your data transformations and data loading processes.
Amazon Simple Workflow Service (SWF) - "helps developers build, run, and scale background jobs that have parallel or sequential steps. You can think of Amazon SWF as a fully-managed state tracker and task coordinator in the Cloud."
AWS Batch - Allows executing jobs as containerized applications running on Amazon ECS. Also includes features for dynamically bidding for Spot Instances, integration with existing workflow engines, scheduling, monitoring, dependency modeling, and dynamic scaling/provisioning based on amount of work.
Google Dataflow - "Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines."

Big Data (Hadoop Stack)

Pig - "a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs."
Spark - "a fast and general-purpose cluster computing system. It provides high-level APIs in Scala, Java, and Python that make parallel jobs easy to write, and an optimized engine that supports general computation graphs. It also supports a rich set of higher-level tools including Shark (Hive on Spark), MLlib for machine learning, GraphX for graph processing, and Spark Streaming."

ETL Tools (GUI)

Warning: If you're already familiar with a scripting language, GUI ETL tools are not a good replacement for a well structured application written with a scripting language. These tools lack flexibility and are a good example of the "inner-platform effect". With a large project, you will most likely run into instances where "the tool doesn't do that" and end up implementing something hacky with a script run by the GUI ETL tool. Also, the GUI can conceal complexity and the files these tools generate are impossible to code review. However, the GUI and out-of-the-box functionality can make some tasks simpler, especially for people not comfortable with writing code.

Apache NiFi - "a rich, web-based interface for designing, controlling, and monitoring a dataflow."
Informatica PowerCenter - "a toolset for establishing and maintaining enterprise-wide data warehouses. It has a customer base of over 5,000 companies."
Microsoft SSIS - "a component of the Microsoft SQL Server database software that can be used to perform a broad range of data migration tasks."
Pentaho Kettle - The most popular open-source graphical ETL tool.
Talend - "an open source application for data integration job design with a graphical development environment"

原文：https://github.com/huiwenhan/awesome-etl

本文：

讨论：请加入知识星球或者小红圈【首席架构师圈】

235 次浏览

SEO Title

A curated list of notable ETL (extract, transform, load) frameworks, libraries and software.

【工作流工具】精选计算数据分析工作流系统

语言 Chinese, Simplified

Computational Data Analysis Workflow Systems

Permalink: https://s.apache.org/existing-workflow-systems

An incomplete list

Please add new entries at the bottom.

Arvados http://arvados.org
Taverna http://www.taverna.org.uk/
Galaxy http://galaxyproject.org/
SHIWA https://www.shiwa-workflow.eu/
Oozie https://oozie.apache.org/
DNANexus https://wiki.dnanexus.com/API-Specification-v1.0.0/IO-and-Run-Specifications# https://wiki.dnanexus.com/API-Specification-v1.0.0/Workflows-and-Analyses#
BioDT http://www.biodatomics.com/
Agave http://agaveapi.co/live-docs/
DiscoveryEnvironment http://www.iplantcollaborative.org/ci/discovery-environment
Wings http://www.wings-workflows.org/
Knime https://www.knime.org/
make, rake, drake, ant, scons & many others. Software development relies heavily on tools to manage workflows related to compiling and packaging applications. For the most part these are file based and usually run on a single node, usually supporting parallel steps (make -j) and in some cases able to dispatch build steps to other machines (https://code.google.com/p/distcc/) https://github.com/Factual/drake
Snakemake https://bitbucket.org/snakemake/snakemake
BPipe http://bpipe.org
Ruffus https://code.google.com/p/ruffus/
NextFlow http://nextflow.io
Luigi http://github.com/spotify/luigi https://luigi.readthedocs.io
SciLuigi. Helper library built on top of Luigi to ease development of Scientific workflows in Luigi: http://github.com/pharmbio/sciluigi
Luigi Analysis Workflow (LAW) https://github.com/riga/law
GATK Queue https://www.broadinstitute.org/gatk/guide/topic?name=queue
Yabi https://ccg.murdoch.edu.au/yabi
seqware Workflows are written in Java and executed using the Oozie Workflow Engine on Hadoop or SGE clusters. Uses Zip64 files to group the workflow definition file, workflow itself, sample settings, and data dependencies in a single file that can be exchanged between SeqWare users or archived. https://seqware.github.io/ https://seqware.github.io/docs/6-pipeline/
Ketrew https://github.com/hammerlab/ketrew
Pegasus http://pegasus.isi.edu/
Apache Airflow https://github.com/apache/airflow
Cosmos https://cosmos.hms.harvard.edu/documentation/index.html http://bioinformatics.oxfordjournals.org/content/early/2014/07/24/bioinformatics.btu385.full [paper] Cosmos2: https://github.com/LPM-HMS/COSMOS2 http://cosmos.hms.harvard.edu/COSMOS2/
Pinball https://github.com/pinterest/pinball
bcbio https://bcbio-nextgen.readthedocs.org/en/latest/
Chronos https://github.com/mesos/chronos
Azkaban https://azkaban.github.io/
Apache NiFi https://nifi.apache.org/docs/nifi-docs/html/overview.html
flowr (R-based) http://docs.flowr.space/ https://github.com/sahilseth/flowr
Mistral https://github.com/arteria-project https://wiki.openstack.org/wiki/Mistral#What_is_Mistral.3F https://docs.openstack.org/mistral/latest/user/wf_lang_v2.html
nipype http://nipy.org/nipype/
End of Day https://github.com/joestubbs/endofday
BioDSL https://github.com/maasha/BioDSL
BigDataScript http://pcingola.github.io/BigDataScript/
Omics Pipe: uses Ruffus http://sulab.scripps.edu/omicspipe/
Ensembl Hive https://github.com/Ensembl/ensembl-hive
QuickNGS http://bifacility.uni-koeln.de/quickngs/web
GenePattern http://www.broadinstitute.org/cancer/software/genepattern/
Chipster http://chipster.csc.fi/
The Genome Modeling System https://github.com/genome/gms
Cuneiform, A Functional Workflow Language https://github.com/joergen7/cuneiform http://www.cuneiform-lang.org/
Anvaya http://www.ncbi.nlm.nih.gov/pubmed/22809419 http://webapp.cabgrid.res.in/biocomp/Anvaya/ANVAYA_Main.html#HOWTO_INSTALL_ANVAYA
Makeflow http://ccl.cse.nd.edu/software/makeflow/
Airavata http://airavata.apache.org/
Pyflow https://github.com/Illumina/pyflow
Cluster Flow http://clusterflow.io
Unipro UGENE http://ugene.net/ https://dx.doi.org/10.7717/peerj.644
CloudSlang http://www.cloudslang.io/
Stacks http://catchenlab.life.illinois.edu/stacks/
Leaf http://www.francesconapolitano.it/leaf/index.html
omictools http://omictools.com/
Job Description Language. The Job Description Language, JDL, is a high-level, user-oriented language based on Condor classified advertisements for describing jobs and aggregates of jobs such as Direct Acyclic Graphs and Collections. https://edms.cern.ch/ui/file/590869/1/WMS-JDL.pdf
YAWL yet another workflow language http://dx.doi.org/10.1016/j.is.2004.02.002 http://www.yawlfoundation.org/
Triquetrum https://projects.eclipse.org/projects/technology.triquetrum https://github.com/eclipse/triquetrum/
Kronos https://github.com/jtaghiyar/kronos
qsubsec http://doi.org/10.1093/bioinformatics/btv698 https://github.com/alastair-droop/qsubsec
YesWorkflow http://yesworkflow.org
gwf - Grid WorkFlow https://github.com/gwforg/gwf http://gwf.readthedocs.io/
Fireworks. https://pythonhosted.org/FireWorks/
NGLess: NGS with less work http://ngless.rtfd.io
pypipegraph https://github.com/TyberiusPrime/pypipegraph
Cromwell https://github.com/broadinstitute/cromwell
Dagobah - Simple DAG-based job scheduler in Python. https://github.com/thieman/dagobah
sushi https://github.com/uzh/sushi
Clinical Trial Processor - A program for processing clinical trials data. http://mircwiki.rsna.org/index.php?title=MIRC_CTP
Noodles http://nlesc.github.io/noodles/
Swift & Swift/T http://swift-lang.org/main/ http://swift-lang.org/Swift-T/
Consonance (runs SeqWare & CWL) https://github.com/Consonance/consonance/wiki
Dog https://github.com/dogtools/dog
Produce https://github.com/texttheater/produce
LONI Pipeline http://pipeline.loni.usc.edu/
Cpipe https://github.com/MelbourneGenomics/cpipe
AWE https://github.com/MG-RAST/AWE
(Py)COMPSs https://www.bsc.es/research-and-development/software-and-apps/software-list/comp-superscalar/
KLIKO https://github.com/gijzelaerr/kliko
SoS Workflow https://github.com/vatlab/SoS https://vatlab.github.io/sos-docs/ https://doi.org/10.1093/bioinformatics/bty405 https://doi.org/10.1371/journal.pcbi.1006843
XNAT Pipeline Engine https://wiki.xnat.org/display/XNAT/Pipeline+Engine https://wiki.xnat.org/display/XNAT/XNAT+Pipeline+Development+Schema
Metapipe https://github.com/TorkamaniLab/metapipe
OCCAM (Open Curation for Computer Architecture Modeling) https://occam.cs.pitt.edu/
Copernicus http://www.copernicus-computing.org
iRODS Rule Language https://github.com/samuell/irods-cheatsheets/blob/master/irods-rule-lang-full-guide.md
VisTrails https://www.vistrails.org
Bionode Watermill https://github.com/bionode/bionode-watermill
BIOVIA Pipeline Pilot Overview http://accelrys.com/products/collaborative-science/biovia-pipeline-pilot/
Dagman A meta-scheduler for HTCondor https://research.cs.wisc.edu/htcondor/dagman/dagman.html
UNICORE https://www.unicore.eu/docstore/workflow-7.6.0/workflow-manual.html#wf_dialect
Toil (A scalable, efficient, cross-platform and easy-to-use workflow engine in pure Python) https://github.com/BD2KGenomics/toil
Cylc (a workflow engine for cycling systems) https://cylc.github.io/
Autodesk Cloud Compute Canon https://github.com/Autodesk/cloud-compute-cannon
Civet https://github.com/TheJacksonLaboratory/civet
Cumulus https://github.com/Kitware/cumulus
High-performance integrated virtual environment (HIVE) https://hive.biochemistry.gwu.edu
Cloudgene http://cloudgene.uibk.ac.at/cloudgene-yaml
FASTR https://bitbucket.org/bigr_erasmusmc/fastr/ http://fastr.readthedocs.io/en/stable/
BioMake https://github.com/evoldoers/biomake http://dx.doi.org/10.1101/093245
remake https://github.com/richfitz/remake
SciFloware http://www-sop.inria.fr/members/Didier.Parigot/pmwiki/Scifloware/
OpenAlea http://openalea.gforge.inria.fr/dokuwiki/doku.php https://hal.archives-ouvertes.fr/hal-01166298/file/openalea-PradalCohen-Boulakia.pdf
COMBUSTI/O https://github.com/jarlebass/combustio http://hdl.handle.net/10037/9361
BioCloud https://github.com/ccwang002/biocloud-server-kai http://doi.org/10.6342/NTU201601295
~~Triana http://www.trianacode.org/~~ (website seems to have been taken over by SEO)
Kepler https://kepler-project.org/
Anduril http://anduril.org/site/
dgsh http://www.dmst.aueb.gr/dds/sw/dgsh/
EDGE bioinformatics: Empowering the Development of Genomics Expertise https://bioedge.lanl.gov/edge_ui/ http://edge.readthedocs.io/ https://lanl-bioinformatics.github.io/EDGE/
Pachyderm http://pachyderm.io/ http://pachyderm.readthedocs.io/en/stable/advanced/advanced.html
Digdag https://www.digdag.io/
Agua / Automated Genomics Utilities Agent http://aguadev.org
BioDepot Workflow Builder (BwB) https://github.com/BioDepot/BioDepot-workflow-builder https://doi.org/10.1101/099010
IMP: a pipeline for reproducible reference-independent integrated metagenomic and metatranscriptomic analyses http://r3lab.uni.lu/web/imp/ https://doi.org/10.1186/s13059-016-1116-8
Butler https://github.com/llevar/butler
adage / yadage https://github.com/diana-hep/adage https://github.com/diana-hep/yadage
HI-WAY: Execution of Scientific Workflows on Hadoop YARN https://github.com/marcbux/Hi-WAY https://openproceedings.org/2017/conf/edbt/paper-248.pdf
OpenMOLE https://github.com/openmole/openmole https://www.openmole.org/ https://doi.org/10.3389/fninf.2017.00021
Biopet https://github.com/biopet/biopet
Nephele https://nephele.niaid.nih.gov/
TOPPAS http://doi.org/10.1021/pr300187f
SBpipe https://pdp10.github.io/sbpipe/ https://github.com/pdp10/sbpipe https://doi.org/10.1186/s12918-017-0423-3
Dray http://dray.it/
GenomeVIP https://github.com/ding-lab/GenomeVIP https://doi.org/10.1101/gr.211656.116
GridSAM https://sourceforge.net/projects/gridsam/
Roddy https://github.com/eilslabs/Roddy
SciFlo (historical; doesn't seem to be maintained anymore) https://web.archive.org/web/20161118011409/https://sciflo.jpl.nasa.gov/SciFloWiki/FrontPage
GNU Guix Workflow Language https://git.roelj.com/guix/gwl.git#gnu-guix-workflow-language-extension https://github.com/UMCUGenetics/guix-workflows/blob/master/umcu/workflows/rnaseq.scm
Porcupine https://timvanmourik.github.io/Porcupine/
Parsl (a Parallel Scripting Library for Python) http://parsl-project.org
ECFLOW (Workflow primarily for Meteorological Applications) https://software.ecmwf.int/wiki/display/ECFLOW/ecflow+home
Ophidia http://ophidia.cmcc.it/
WebLicht https://weblicht.sfs.uni-tuebingen.de/
GATE Cloud https://cloud.gate.ac.uk/
SCIPION http://scipion.cnb.csic.es/m/home/ https://github.com/I2PC/scipion/wiki/Creating-a-Protocol
Ergatis http://ergatis.sourceforge.net/
TIGR "Workflow" https://sourceforge.net/projects/tigr-workflow/ http://tigr-workflow.sourceforge.net/
Archivematica https://wiki.archivematica.org/Main_Page (A preservation workflow system that implements the ISO-OAIS standard using gearman/MCP)
Martian http://martian-lang.org/about/
BioMAJ http://genouest.github.io/biomaj/
Conveyor http://conveyor.cebitec.uni-bielefeld.de (retired). https://academic.oup.com/bioinformatics/article/27/7/903/230562/Conveyor-a-workflow-engine-for-bioinformatic
Biopipe http://www.biopipe.org (appears to be defunct) https://www.ncbi.nlm.nih.gov/pmc/articles/PMC403782/
Wildfire http://wildfire.bii.a-star.edu.sg/ https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-6-69
BioWBI http://bioinformatics.hsanmartino.it/bits_library/library/00079.pdf
BioWMS http://bioinformatics.hsanmartino.it/bits_library/library/00568.pdf
BioMoby http://biomoby.open-bio.org/ https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-7-523
SIBIOS http://ieeexplore.ieee.org/document/1309094/
NGSANE https://github.com/BauerLab/ngsane https://academic.oup.com/bioinformatics/article/30/10/1471/266879/NGSANE-a-lightweight-production-informatics
Pwrake https://github.com/misshie/Workflows https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3180464/
Nesoni https://github.com/Victorian-Bioinformatics-Consortium/nesoni
Skam http://skam.sourceforge.net/skam-intro.html
TREVA http://bioinformatics.petermac.org/treva/ http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0095217
EGene https://www.semanticscholar.org/paper/EGene-a-configurable-pipeline-generation-system-fo-Durham-Kashiwabara/4c0656195b5efcdd3aa7bdcb55fc95a957c150aa https://academic.oup.com/bioinformatics/article/30/18/2659/2475637/EuGene-PP-a-next-generation-automated-annotation
WEP https://bioinformatics.cineca.it/wep/ https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-14-S7-S11
Microbase http://www.microbasecloud.com/
e-Science Central http://www.esciencecentral.co.uk/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3538293/
Cyrille2 https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-9-96
PaPy https://code.google.com/archive/p/papy/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3051902/
JobCenter https://github.com/yeastrc/jobcenter https://scfbm.biomedcentral.com/articles/10.1186/1751-0473-7-8
CoreFlow https://www.ncbi.nlm.nih.gov/pubmed/24503186
dynamic-pipeline https://code.google.com/archive/p/dynamic-pipeline/
XiP http://xip.hgc.jp/wiki/en/Main_Page https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3530915/
Eoulsan http://www.outils.genomique.biologie.ens.fr/eoulsan/ https://www.ncbi.nlm.nih.gov/pubmed/22492314
CloudDOE http://clouddoe.iis.sinica.edu.tw/
BioPig https://github.com/JGI-Bioinformatics/biopig https://www.ncbi.nlm.nih.gov/pubmed/24021384
SeqPig https://github.com/HadoopGenomics/SeqPig https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3866557/
zymake http://www-personal.umich.edu/~ebreck/code/zymake/
JMS https://github.com/RUBi-ZA/JMS http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0134273
CLC Genomics Workbench https://www.qiagenbioinformatics.com/products/clc-genomics-workbench/
NG6 http://ng6.toulouse.inra.fr/ https://www.ncbi.nlm.nih.gov/pubmed/22958229
VIBE http://www.incogen.com/vibe/
WDL (Workflow Description Language) https://github.com/broadinstitute/wdl
SciFlow https://github.com/kaizhang/SciFlow (not to be confused with SciFloware and SciFlo).
Bioshake https://github.com/PapenfussLab/bioshake
SciPipe http://scipipe.org
Kapacitor / TICKscripts https://docs.influxdata.com/kapacitor/v1.3//tick/
AiiDA: Automated Interactive Infrastructure and Database for Computational Science http://www.aiida.net/
Reflow: a language and runtime for distributed, integrated data processing in the cloud https://github.com/grailbio/reflow
Resolwe: an open source dataflow package for Django framework https://github.com/genialis/resolwe
Yahoo! Pipes (historical) https://en.wikipedia.org/wiki/Yahoo!_Pipes
Walrus https://github.com/fjukstad/walrus
Apache Beam https://beam.apache.org/
CLOSHA https://closha.kobic.re.kr/ https://www.bioexpress.re.kr/go_tutorial http://docplayer.net/19700397-Closha-manual-ver1-1-kobic-korean-bioinformation-center-kogun82-kribb-re-kr-2016-05-08-bioinformatics-workflow-management-system-in-bio-express.html https://doi.org/10.1186/s12859-018-2019-3
WopMars https://github.com/aitgon/wopmars http://wopmars.readthedocs.io/
flowing-clj https://github.com/stain/flowing-clj
Plumbing and Graph https://github.com/plumatic/plumbing
LabView http://www.ni.com/en-us/shop/labview.html
MyOpenLab http://myopenlab.org/
Max/MSP https://cycling74.com/products/max/
NoFlo https://noflojs.org/
Flowstone http://www.dsprobotics.com/flowstone.html
HyperLoom https://code.it4i.cz/ADAS/loom https://code.it4i.cz/ADAS/loom
Dask http://dask.pydata.org/en/latest/ https://github.com/dask/dask
Stimela https://github.com/SpheMakh/Stimela https://github.com/SpheMakh/Stimela/wiki https://www.acru.ukzn.ac.za/~cosmosafari2017/wp-content/uploads/2017/02/makhathini.pdf
JTracker https://jtracker.io/ https://github.com/jtracker-io
PipelineDog http://pipeline.dog/ https://github.com/zhouanbo/pipelinedog https://doi.org/10.1093/bioinformatics/btx759
DALiuGE https://arxiv.org/abs/1702.07617 https://github.com/ICRAR/daliuge https://daliuge.readthedocs.io/
Overseer https://github.com/framed-data/overseer
Squonk https://squonk.it/
GC3Pie https://github.com/uzh/gc3pie
Fractalide https://github.com/fractalide/fractalide
TOGGLe https://doi.org/10.1101/245480 http://toggle.southgreen.fr/
Askalon http://www.askalon.org
Eclipse ICE (The Integrated Computational Environment) https://www.eclipse.org/ice
Sandia Analysis Workbench (SAW) http://www.sandia.gov/saw/
dispel4py https://github.com/dispel4py/dispel4py
Jobber https://pypi.python.org/pypi/Jobber/0.1.4
NeatSeq-Flow http://neatseq-flow.readthedocs.io/
S4M https://bitbucket.org/uqokorn/s4m_base/wiki/Home
Loom http://med.stanford.edu/gbsc/loom.html https://github.com/StanfordBioinformatics/loom http://loom.readthedocs.io/en/latest/templates.html
Watchdog https://doi.org/10.1186/s12859-018-2107-4 https://github.com/klugem/watchdog
phpflo https://github.com/phpflo/phpflo
BASTet: Berkeley Analysis and Storage Toolkit https://openmsi.nersc.gov/openmsi/client/bastet.html https://biorack.github.io/BASTet/ https://doi.org/10.1109/TVCG.2017.2744479
Tavaxy: Pattern based workflow system for the bioinformatics domain http://www.tavaxy.org/
Ginflow: Decentralised adaptive workflow engine https://ginflow.inria.fr/
SciApps: A cloud-based platform for reproducible bioinformatics workflows https://doi.org/10.1093/bioinformatics/bty439 https://www.sciapps.org/
Stoa: Script Tracking for Observational Astronomy https://github.com/petehague/Stoa
Collective Knowledge (CK) framework http://cknowledge.org/
QosCosGrid (QCG) http://www.qoscosgrid.org/ http://www.qoscosgrid.org/trac/qcg-broker/wiki/qcg-advanced-client%20
High-Throughput Binding Affinity Calculator (HTBAC) https://htbac.readthedocs.io/en/latest/ https://github.com/radical-cybertools/htbac https://arxiv.org/abs/1801.01174
BioWorkbench (Swift-based) https://arxiv.org/abs/1801.03915 https://github.com/mmondelli/bioworkbench
ENVI Task Engine https://gbdxdocs.digitalglobe.com/docs/envi-task-engine https://www.harrisgeospatial.com/Learn/Whitepapers/TabId/2359/ArtMID/10212/ArticleID/17299/Workflow-Tools-in-ENVI.aspx https://envi-py-engine.readthedocs.io/en/latest/index.html
Pypeline https://github.com/cgarciae/pypeln
mpipe http://vmlaker.github.io/mpipe/
idseq-dag https://github.com/chanzuckerberg/idseq-dag
Piper (based upon GATK Queue) https://github.com/NationalGenomicsInfrastructure/piper
Apache Object Oriented Data Technology (OODT) http://oodt.apache.org/
JX Workflow (DSL for Makeflow) https://ccl.cse.nd.edu/software/manuals/jx-quick.html http://ccl.cse.nd.edu/research/papers/jx-escience-2018.pdf
The Adaptable IO System (ADIOS), ADIOS using applications can be the orchestrated into a workflow http://csmd.ornl.gov/adios
GenPipes https://doi.org/10.1101/459552 https://bitbucket.org/mugqic/genpipes/src/master/
Argo https://argoproj.github.io/ https://github.com/argoproj/argo https://github.com/argoproj/argo/blob/master/examples/README.md
Reana https://reana.readthedocs.io/en/latest/ https://github.com/reanahub/reana
Cuisine Framework https://www.astron.nl/~renting/cuisine.html
Niassa https://github.com/oicr-gsi/niassa https://oicr-gsi.github.io/niassa-docs/
pypeFLOW https://github.com/PacificBiosciences/pypeFLOW
Tiny Cloud Engine http://ka.cb.k.u-tokyo.ac.jp/tce/
Xbowflow https://github.com/ChrisSuess/Project-Xbow/tree/master/xbowflow
AdaptiveMd https://github.com/markovmodel/adaptivemd
Meshroom https://github.com/alicevision/meshroom
LSST Data Management https://github.com/lsst/pipe_base
CGAT-core https://github.com/cgat-developers/cgat-core
Prefect https://docs.prefect.io/
Apache SCXML engine https://commons.apache.org/proper/commons-scxml/guide/core-engine.html https://commons.apache.org/proper/commons-scxml/guide/scxml-documents.html
IceProd https://github.com/WIPACrepo/iceprod
AnADAMA2 http://huttenhower.sph.harvard.edu/anadama2
Luna https://luna-lang.org/
Passerelle https://code.google.com/archive/a/eclipselabs.org/p/passerelle
Kurator-Akka https://github.com/kurator-org/kurator-akka
Jug http://doi.org/10.5334/jors.161
Node-RED https://nodered.org/
Databolt Flow https://github.com/d6t/d6tflow
Frictionless Data Package Pipelines https://github.com/frictionlessdata/datapackage-pipelines
DataFlows https://github.com/datahq/dataflows
Volcano https://github.com/volcano-sh/volcano
DataJoint https://datajoint.io/
DIRAC3 (LHCb grid software) https://iopscience.iop.org/article/10.1088/1742-6596/219/6/062029

原文：https://github.com/common-workflow-language/common-workflow-language/wiki/Existing-Workflow-systems

本文：

讨论：请加入知识星球或者小红圈【首席架构师圈】

98 次浏览

SEO Title

Computational Data Analysis Workflow Systems

【机器学习精选】精选的机器学习框架，库和软件的精选列表。

语言 Chinese, Simplified

Awesome Machine Learning

A curated list of awesome machine learning frameworks, libraries and software (by language). Inspired by awesome-php.

If you want to contribute to this list (please do), send me a pull request or contact me @josephmisiti. Also, a listed repository should be deprecated if:

Repository's owner explicitly say that "this library is not maintained".
Not committed for long time (2~3 years).

Further resources:

For a list of free machine learning books available for download, go here.
For a list of (mostly) free machine learning courses available online, go here.
For a list of blogs and newsletters on data science and machine learning, go here.
For a list of free-to-attend meetups and local events, go here.

Frameworks and Libraries

Tools

Credits

APL

General-Purpose Machine Learning

naive-apl - Naive Bayesian Classifier implementation in APL. [Deprecated]

C

General-Purpose Machine Learning

Darknet - Darknet is an open source neural network framework written in C and CUDA. It is fast, easy to install, and supports CPU and GPU computation.
Recommender - A C library for product recommendations/suggestions using collaborative filtering (CF).
Hybrid Recommender System - A hybrid recommender system based upon scikit-learn algorithms. [Deprecated]
neonrvm - neonrvm is an open source machine learning library based on RVM technique. It's written in C programming language and comes with Python programming language bindings.

Computer Vision

CCV - C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library.
VLFeat - VLFeat is an open and portable library of computer vision algorithms, which has Matlab toolbox.

C++

Computer Vision

DLib - DLib has C++ and Python interfaces for face detection and training general object detectors.
EBLearn - Eblearn is an object-oriented C++ library that implements various machine learning models [Deprecated]
OpenCV - OpenCV has C++, C, Python, Java and MATLAB interfaces and supports Windows, Linux, Android and Mac OS.
VIGRA - VIGRA is a generic cross-platform C++ computer vision and machine learning library for volumes of arbitrary dimensionality with Python bindings.

General-Purpose Machine Learning

BanditLib - A simple Multi-armed Bandit library. [Deprecated]
Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind. [DEEP LEARNING]
CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box. It is easy to install, contains fast inference implementation and supports CPU and GPU (even multi-GPU) computation.
CNTK - The Computational Network Toolkit (CNTK) by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph.
CUDA - This is a fast C++/CUDA implementation of convolutional [DEEP LEARNING]
DeepDetect - A machine learning API and server written in C++11. It makes state of the art machine learning easy to work with and integrate into existing applications.
Distributed Machine learning Tool Kit (DMTK) - A distributed machine learning (parameter server) framework by Microsoft. Enables training models on large data sets across multiple machines. Current tools bundled with it include: LightLDA and Distributed (Multisense) Word Embedding.
DLib - A suite of ML tools designed to be easy to imbed in other applications.
DSSTNE - A software library created by Amazon for training and deploying deep neural networks using GPUs which emphasizes speed and scale over experimental flexibility.
DyNet - A dynamic neural network library working well with networks that have dynamic structures that change for every training instance. Written in C++ with bindings in Python.
Fido - A highly-modular C++ machine learning library for embedded electronics and robotics.
igraph - General purpose graph library.
Intel(R) DAAL - A high performance software library developed by Intel and optimized for Intel's architectures. Library provides algorithmic building blocks for all stages of data analytics and allows to process data in batch, online and distributed modes.
LightGBM - Microsoft's fast, distributed, high performance gradient boosting (GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
libfm - A generic approach that allows to mimic most factorization models by feature engineering.
MLDB - The Machine Learning Database is a database designed for machine learning. Send it commands over a RESTful API to store data, explore it using SQL, then train machine learning models and expose them as APIs.
mlpack - A scalable C++ machine learning library.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
proNet-core - A general-purpose network embedding framework: pair-wise representations optimization Network Edit.
PyCUDA - Python interface to CUDA
ROOT - A modular scientific software framework. It provides all the functionalities needed to deal with big data processing, statistical analysis, visualization and storage.
shark - A fast, modular, feature-rich open-source C++ machine learning library.
Shogun - The Shogun Machine Learning Toolbox.
sofia-ml - Suite of fast incremental algorithms.
Stan - A probabilistic programming language implementing full Bayesian statistical inference with Hamiltonian Monte Carlo sampling.
Timbl - A software package/C++ library implementing several memory-based learning algorithms, among which IB1-IG, an implementation of k-nearest neighbor classification, and IGTree, a decision-tree approximation of IB1-IG. Commonly used for NLP.
Vowpal Wabbit (VW) - A fast out-of-core learning system.
Warp-CTC - A fast parallel implementation of Connectionist Temporal Classification (CTC), on both CPU and GPU.
XGBoost - A parallelized optimized general purpose gradient boosting library.
ThunderGBM - A fast library for GBDTs and Random Forests on GPUs.
ThunderSVM - A fast SVM library on GPUs and CPUs.
LKYDeepNN - A header-only C++11 Neural Network library. Low dependency, native traditional chinese document.
xLearn - A high performance, easy-to-use, and scalable machine learning package, which can be used to solve large-scale machine learning problems. xLearn is especially useful for solving machine learning problems on large-scale sparse data, which is very common in Internet services such as online advertisement and recommender systems.
Featuretools - A library for automated feature engineering. It excels at transforming transactional and relational datasets into feature matrices for machine learning using reusable feature engineering "primitives".
skynet - A library for learning neural network, has C-interface, net set in JSON. Written in C++ with bindings in Python, C++ and C#.
Feast - A feature store for the management, discovery, and access of machine learning features. Feast provides a consistent view of feature data for both model training and model serving.
Polyaxon - A platform for reproducible and scalable machine learning and deep learning.

Natural Language Processing

BLLIP Parser - BLLIP Natural Language Parser (also known as the Charniak-Johnson parser).
colibri-core - C++ library, command line tools, and Python binding for extracting and working with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
CRF++ - Open source implementation of Conditional Random Fields (CRFs) for segmenting/labeling sequential data & other Natural Language Processing tasks. [Deprecated]
CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data. [Deprecated]
frog - Memory-based NLP suite developed for Dutch: PoS tagger, lemmatiser, dependency parser, NER, shallow parser, morphological analyzer.
libfolia - C++ library for the FoLiA format
MeTA - MeTA : ModErn Text Analysis is a C++ Data Sciences Toolkit that facilitates mining big text data.
MIT Information Extraction Toolkit - C, C++, and Python tools for named entity recognition and relation extraction
ucto - Unicode-aware regular-expression based tokenizer for various languages. Tool and C++ library. Supports FoLiA format.

Speech Recognition

Kaldi - Kaldi is a toolkit for speech recognition written in C++ and licensed under the Apache License v2.0. Kaldi is intended for use by speech recognition researchers.

Sequence Analysis

ToPS - This is an objected-oriented framework that facilitates the integration of probabilistic models for sequences over a user defined alphabet. [Deprecated]

Gesture Detection

grt - The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for real-time gesture recognition.

Common Lisp

General-Purpose Machine Learning

mgl - Neural networks (boltzmann machines, feed-forward and recurrent nets), Gaussian Processes.
mgl-gpr - Evolutionary algorithms. [Deprecated]
cl-libsvm - Wrapper for the libsvm support vector machine library. [Deprecated]
cl-online-learning - Online learning algorithms (Perceptron, AROW, SCW, Logistic Regression).
cl-random-forest - Implementation of Random Forest in Common Lisp.

Clojure

Natural Language Processing

Clojure-openNLP - Natural Language Processing in Clojure (opennlp).
Infections-clj - Rails-like inflection library for Clojure and ClojureScript.

General-Purpose Machine Learning

Touchstone - Clojure A/B testing library. [Deprecated]
Clojush - The Push programming language and the PushGP genetic programming system implemented in Clojure.
Infer - Inference and machine learning in Clojure. [Deprecated]
Clj-ML - A machine learning library for Clojure built on top of Weka and friends. [Deprecated]
DL4CLJ - Clojure wrapper for Deeplearning4j.
Encog - Clojure wrapper for Encog (v3) (Machine-Learning framework that specializes in neural-nets). [Deprecated]
Fungp - A genetic programming library for Clojure. [Deprecated]
Statistiker - Basic Machine Learning algorithms in Clojure. [Deprecated]
clortex - General Machine Learning library using Numenta’s Cortical Learning Algorithm. [Deprecated]
comportex - Functionally composable Machine Learning library using Numenta’s Cortical Learning Algorithm. [Deprecated]
cortex - Neural networks, regression and feature learning in Clojure.
lambda-ml - Simple, concise implementations of machine learning techniques and utilities in Clojure.

Data Analysis / Data Visualization

Incanter - Incanter is a Clojure-based, R-like platform for statistical computing and graphics.
PigPen - Map-Reduce for Clojure.
Envision - Clojure Data Visualisation library, based on Statistiker and D3.

Crystal

General-Purpose Machine Learning

machine - Simple machine learning algorithm.
crystal-fann - FANN (Fast Artificial Neural Network) binding.

Elixir

General-Purpose Machine Learning

Simple Bayes - A Simple Bayes / Naive Bayes implementation in Elixir.
emel - A simple and functional machine learning library written in Elixir.

Natural Language Processing

Stemmer - An English (Porter2) stemming implementation in Elixir.

Erlang

General-Purpose Machine Learning

Disco - Map Reduce in Erlang. [Deprecated]
Yanni - ANN neural networks using Erlangs leightweight processes.

Go

Natural Language Processing

snowball - Snowball Stemmer for Go.
word-embedding - Word Embeddings: the full implementation of word2vec, GloVe in Go.
sentences - Golang implementation of Punkt sentence tokenizer.
go-ngram - In-memory n-gram index with compression. [Deprecated]
paicehusk - Golang implementation of the Paice/Husk Stemming Algorithm. [Deprecated]
go-porterstemmer - A native Go clean room implementation of the Porter Stemming algorithm. [Deprecated]

General-Purpose Machine Learning

birdland - A recommendation library in Go.
eaopt - An evolutionary optimization library.
leaves - A pure Go implementation of the prediction part of GBRTs, including XGBoost and LightGBM.
gobrain - Neural Networks written in Go.
go-mxnet-predictor - Go binding for MXNet c_predict_api to do inference with pre-trained model.
go-ml-transpiler - An open source Go transpiler for machine learning models.
golearn - Machine learning for Go.
goml - Machine learning library written in pure Go.
gorgonia - Deep learning in Go.
therfoo - An embedded deep learning library for Go.
neat - Plug-and-play, parallel Go framework for NeuroEvolution of Augmenting Topologies (NEAT). [Deprecated]
go-pr - Pattern recognition package in Go lang. [Deprecated]
go-ml - Linear / Logistic regression, Neural Networks, Collaborative Filtering and Gaussian Multivariate Distribution. [Deprecated]
GoNN - GoNN is an implementation of Neural Network in Go Language, which includes BPNN, RBF, PCN. [Deprecated]
bayesian - Naive Bayesian Classification for Golang. [Deprecated]
go-galib - Genetic Algorithms library written in Go / Golang. [Deprecated]
Cloudforest - Ensembles of decision trees in Go/Golang. [Deprecated]

Spatial analysis and geometry

go-geom - Go library to handle geometries.
gogeo - Spherical geometry in Go.

Data Analysis / Data Visualization

gota - Dataframes.
gonum/mat - A linear algebra package for Go.
gonum/optimize - Implementations of optimization algorithms.
gonum/plot - A plotting library.
gonum/stat - A statistics library.
SVGo - The Go Language library for SVG generation.
glot - Glot is a plotting library for Golang built on top of gnuplot.
globe - Globe wireframe visualization.
gonum/graph - General-purpose graph library.
go-graph - Graph library for Go/Golang language. [Deprecated]
RF - Random forests implementation in Go. [Deprecated]

Computer vision

GoCV - Package for computer vision using OpenCV 4 and beyond.

Haskell

General-Purpose Machine Learning

haskell-ml - Haskell implementations of various ML algorithms. [Deprecated]
HLearn - a suite of libraries for interpreting machine learning models according to their algebraic structure. [Deprecated]
hnn - Haskell Neural Network library.
hopfield-networks - Hopfield Networks for unsupervised learning in Haskell. [Deprecated]
DNNGraph - A DSL for deep neural networks. [Deprecated]
LambdaNet - Configurable Neural Networks in Haskell. [Deprecated]

Java

Natural Language Processing

Cortical.io - Retina: an API performing complex NLP operations (disambiguation, classification, streaming text filtering, etc...) as quickly and intuitively as the brain.
IRIS - Cortical.io's FREE NLP, Retina API Analysis Tool (written in JavaFX!) - See the Tutorial Video.
CoreNLP - Stanford CoreNLP provides a set of natural language analysis tools which can take raw English language text input and give the base forms of words.
Stanford Parser - A natural language parser is a program that works out the grammatical structure of sentences.
Stanford POS Tagger - A Part-Of-Speech Tagger (POS Tagger).
Stanford Name Entity Recognizer - Stanford NER is a Java implementation of a Named Entity Recognizer.
Stanford Word Segmenter - Tokenization of raw text is a standard pre-processing step for many NLP tasks.
Tregex, Tsurgeon and Semgrex - Tregex is a utility for matching patterns in trees, based on tree relationships and regular expression matches on nodes (the name is short for "tree regular expressions").
Stanford Phrasal: A Phrase-Based Translation System
Stanford English Tokenizer - Stanford Phrasal is a state-of-the-art statistical phrase-based machine translation system, written in Java.
Stanford Tokens Regex - A tokenizer divides text into a sequence of tokens, which roughly correspond to "words".
Stanford Temporal Tagger - SUTime is a library for recognizing and normalizing time expressions.
Stanford SPIED - Learning entities from unlabeled text starting with seed sets using patterns in an iterative fashion.
Stanford Topic Modeling Toolbox - Topic modeling tools to social scientists and others who wish to perform analysis on datasets.
Twitter Text Java - A Java implementation of Twitter's text processing library.
MALLET - A Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.
OpenNLP - a machine learning based toolkit for the processing of natural language text.
LingPipe - A tool kit for processing text using computational linguistics.
ClearTK - ClearTK provides a framework for developing statistical natural language processing (NLP) components in Java and is built on top of Apache UIMA. [Deprecated]
Apache cTAKES - Apache clinical Text Analysis and Knowledge Extraction System (cTAKES) is an open-source natural language processing system for information extraction from electronic medical record clinical free-text.
NLP4J - The NLP4J project provides software and resources for natural language processing. The project started at the Center for Computational Language and EducAtion Research, and is currently developed by the Center for Language and Information Research at Emory University. [Deprecated]
CogcompNLP - This project collects a number of core libraries for Natural Language Processing (NLP) developed in the University of Illinois' Cognitive Computation Group, for example illinois-core-utilities which provides a set of NLP-friendly data structures and a number of NLP-related utilities that support writing NLP applications, running experiments, etc, illinois-edison a library for feature extraction from illinois-core-utilities data structures and many other packages.

General-Purpose Machine Learning

aerosolve - A machine learning library by Airbnb designed from the ground up to be human friendly.
AMIDST Toolbox - A Java Toolbox for Scalable Probabilistic Machine Learning.
Datumbox - Machine Learning framework for rapid development of Machine Learning and Statistical applications.
ELKI - Java toolkit for data mining. (unsupervised: clustering, outlier detection etc.)
Encog - An advanced neural network and machine learning framework. Encog contains classes to create a wide variety of networks, as well as support classes to normalize and process data for these neural networks. Encog trains using multithreaded resilient propagation. Encog can also make use of a GPU to further speed processing time. A GUI based workbench is also provided to help model and train neural networks.
FlinkML in Apache Flink - Distributed machine learning library in Flink.
H2O - ML engine that supports distributed learning on Hadoop, Spark or your laptop via APIs in R, Python, Scala, REST/JSON.
htm.java - General Machine Learning library using Numenta’s Cortical Learning Algorithm.
liblinear-java - Java version of liblinear.
Mahout - Distributed machine learning.
Meka - An open source implementation of methods for multi-label classification and evaluation (extension to Weka).
MLlib in Apache Spark - Distributed machine learning library in Spark
Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
Neuroph - Neuroph is lightweight Java neural network framework
ORYX - Lambda Architecture Framework using Apache Spark and Apache Kafka with a specialization for real-time large-scale machine learning.
Samoa SAMOA is a framework that includes distributed machine learning for data streams with an interface to plug-in different stream processing platforms.
RankLib - RankLib is a library of learning to rank algorithms. [Deprecated]
rapaio - statistics, data mining and machine learning toolbox in Java.
RapidMiner - RapidMiner integration into Java code.
Stanford Classifier - A classifier is a machine learning tool that will take data items and place them into one of k classes.
SmileMiner - Statistical Machine Intelligence & Learning Engine.
SystemML - flexible, scalable machine learning (ML) language.
Weka - Weka is a collection of machine learning algorithms for data mining tasks.
LBJava - Learning Based Java is a modeling language for the rapid development of software systems, offers a convenient, declarative syntax for classifier and constraint definition directly in terms of the objects in the programmer's application.

Speech Recognition

CMU Sphinx - Open Source Toolkit For Speech Recognition purely based on Java speech recognition library.

Data Analysis / Data Visualization

Flink - Open source platform for distributed stream and batch data processing.
Hadoop - Hadoop/HDFS.
Onyx - Distributed, masterless, high performance, fault tolerant data processing. Written entirely in Clojure.
Spark - Spark is a fast and general engine for large-scale data processing.
Storm - Storm is a distributed realtime computation system.
Impala - Real-time Query for Hadoop.
DataMelt - Mathematics software for numeric computation, statistics, symbolic calculations, data analysis and data visualization.
Dr. Michael Thomas Flanagan's Java Scientific Library [Deprecated]

Deep Learning

Deeplearning4j - Scalable deep learning for industry with parallel GPUs.
Keras Beginner Tutorial - Friendly guide on using Keras to implement a simple Neural Network in Python

Javascript

Natural Language Processing

Twitter-text - A JavaScript implementation of Twitter's text processing library.
natural - General natural language facilities for node.
Knwl.js - A Natural Language Processor in JS.
Retext - Extensible system for analyzing and manipulating natural language.
NLP Compromise - Natural Language processing in the browser.
nlp.js - An NLP library built in node over Natural, with entity extraction, sentiment analysis, automatic language identify, and so more

Data Analysis / Data Visualization

D3.js
High Charts
NVD3.js
dc.js
chartjs
dimple
amCharts
D3xter - Straight forward plotting built on D3. [Deprecated]
statkit - Statistics kit for JavaScript. [Deprecated]
datakit - A lightweight framework for data analysis in JavaScript
science.js - Scientific and statistical computing in JavaScript. [Deprecated]
Z3d - Easily make interactive 3d plots built on Three.js [Deprecated]
Sigma.js - JavaScript library dedicated to graph drawing.
C3.js - customizable library based on D3.js for easy chart drawing.
Datamaps - Customizable SVG map/geo visualizations using D3.js. [Deprecated]
ZingChart - library written on Vanilla JS for big data visualization.
cheminfo - Platform for data visualization and analysis, using the visualizer project.
Learn JS Data
AnyChart
FusionCharts
Nivo - built on top of the awesome d3 and Reactjs libraries

General-Purpose Machine Learning

Auto ML - Automated machine learning, data formatting, ensembling, and hyperparameter optimization for competitions and exploration- just give it a .csv file!
Convnet.js - ConvNetJS is a Javascript library for training Deep Learning models[DEEP LEARNING] [Deprecated]
Clusterfck - Agglomerative hierarchical clustering implemented in Javascript for Node.js and the browser. [Deprecated]
Clustering.js - Clustering algorithms implemented in Javascript for Node.js and the browser. [Deprecated]
Decision Trees - NodeJS Implementation of Decision Tree using ID3 Algorithm. [Deprecated]
DN2A - Digital Neural Networks Architecture. [Deprecated]
figue - K-means, fuzzy c-means and agglomerative clustering.
Gaussian Mixture Model - Unsupervised machine learning with multivariate Gaussian mixture model.
Node-fann - FANN (Fast Artificial Neural Network Library) bindings for Node.js [Deprecated]
Keras.js - Run Keras models in the browser, with GPU support provided by WebGL 2.
Kmeans.js - Simple Javascript implementation of the k-means algorithm, for node.js and the browser. [Deprecated]
LDA.js - LDA topic modeling for Node.js
Learning.js - Javascript implementation of logistic regression/c4.5 decision tree [Deprecated]
machinelearn.js - Machine Learning library for the web, Node.js and developers
mil-tokyo - List of several machine learning libraries.
Node-SVM - Support Vector Machine for Node.js
Brain - Neural networks in JavaScript [Deprecated]
Brain.js - Neural networks in JavaScript - continued community fork of Brain.
Bayesian-Bandit - Bayesian bandit implementation for Node and the browser. [Deprecated]
Synaptic - Architecture-free neural network library for Node.js and the browser.
kNear - JavaScript implementation of the k nearest neighbors algorithm for supervised learning.
NeuralN - C++ Neural Network library for Node.js. It has advantage on large dataset and multi-threaded training. [Deprecated]
kalman - Kalman filter for Javascript. [Deprecated]
shaman - Node.js library with support for both simple and multiple linear regression. [Deprecated]
ml.js - Machine learning and numerical analysis tools for Node.js and the Browser!
ml5 - Friendly machine learning for the web!
Pavlov.js - Reinforcement learning using Markov Decision Processes.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
TensorFlow.js - A WebGL accelerated, browser based JavaScript library for training and deploying ML models.
JSMLT - Machine learning toolkit with classification and clustering for Node.js; supports visualization (see visualml.io).
xgboost-node - Run XGBoost model and make predictions in Node.js.
Netron - Visualizer for machine learning models.
WebDNN - Fast Deep Neural Network Javascript Framework. WebDNN uses next generation JavaScript API, WebGPU for GPU execution, and WebAssembly for CPU execution.

Misc

stdlib - A standard library for JavaScript and Node.js, with an emphasis on numeric computing. The library provides a collection of robust, high performance libraries for mathematics, statistics, streams, utilities, and more.
sylvester - Vector and Matrix math for JavaScript. [Deprecated]
simple-statistics - A JavaScript implementation of descriptive, regression, and inference statistics. Implemented in literate JavaScript with no dependencies, designed to work in all modern browsers (including IE) as well as in Node.js.
regression-js - A javascript library containing a collection of least squares fitting methods for finding a trend in a set of data.
Lyric - Linear Regression library. [Deprecated]
GreatCircle - Library for calculating great circle distance.
MLPleaseHelp - MLPleaseHelp is a simple ML resource search engine. You can use this search engine right now at https://jgreenemi.github.io/MLPleaseHelp/, provided via Github Pages.

Demos and Scripts

The Bot - Example of how the neural network learns to predict the angle between two points created with Synaptic.
Half Beer - Beer glass classifier created with Synaptic.

Julia

General-Purpose Machine Learning

MachineLearning - Julia Machine Learning library. [Deprecated]
MLBase - A set of functions to support the development of machine learning algorithms.
PGM - A Julia framework for probabilistic graphical models.
DA - Julia package for Regularized Discriminant Analysis.
Regression - Algorithms for regression analysis (e.g. linear regression and logistic regression). [Deprecated]
Local Regression - Local regression, so smooooth!
Naive Bayes - Simple Naive Bayes implementation in Julia. [Deprecated]
Mixed Models - A Julia package for fitting (statistical) mixed-effects models.
Simple MCMC - basic mcmc sampler implemented in Julia. [Deprecated]
Distances - Julia module for Distance evaluation.
Decision Tree - Decision Tree Classifier and Regressor.
Neural - A neural network in Julia.
MCMC - MCMC tools for Julia. [Deprecated]
Mamba - Markov chain Monte Carlo (MCMC) for Bayesian analysis in Julia.
GLM - Generalized linear models in Julia.
Gaussian Processes - Julia package for Gaussian processes.
Online Learning [Deprecated]
GLMNet - Julia wrapper for fitting Lasso/ElasticNet GLM models using glmnet.
Clustering - Basic functions for clustering data: k-means, dp-means, etc.
SVM - SVM's for Julia. [Deprecated]
Kernel Density - Kernel density estimators for julia.
MultivariateStats - Methods for dimensionality reduction.
NMF - A Julia package for non-negative matrix factorization.
ANN - Julia artificial neural networks. [Deprecated]
Mocha - Deep Learning framework for Julia inspired by Caffe. [Deprecated]
XGBoost - eXtreme Gradient Boosting Package in Julia.
ManifoldLearning - A Julia package for manifold learning and nonlinear dimensionality reduction.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
Merlin - Flexible Deep Learning Framework in Julia.
ROCAnalysis - Receiver Operating Characteristics and functions for evaluation probabilistic binary classifiers.
GaussianMixtures - Large scale Gaussian Mixture Models.
ScikitLearn - Julia implementation of the scikit-learn API.
Knet - Koç University Deep Learning Framework.
Flux - Relax! Flux is the ML library that doesn't make you tensor

Natural Language Processing

Topic Models - TopicModels for Julia. [Deprecated]
Text Analysis - Julia package for text analysis.
Word Tokenizers - Tokenizers for Natural Language Processing in Julia
Corpus Loaders - A julia package providing a variety of loaders for various NLP corpora.
Embeddings - Functions and data dependencies for loading various word embeddings
Languages - Julia package for working with various human languages
WordNet - A Julia package for Princeton's WordNet

Data Analysis / Data Visualization

Graph Layout - Graph layout algorithms in pure Julia.
LightGraphs - Graph modeling and analysis.
Data Frames Meta - Metaprogramming tools for DataFrames.
Julia Data - library for working with tabular data in Julia. [Deprecated]
Data Read - Read files from Stata, SAS, and SPSS.
Hypothesis Tests - Hypothesis tests for Julia.
Gadfly - Crafty statistical graphics for Julia.
Stats - Statistical tests for Julia.
RDataSets - Julia package for loading many of the data sets available in R.
DataFrames - library for working with tabular data in Julia.
Distributions - A Julia package for probability distributions and associated functions.
Data Arrays - Data structures that allow missing values. [Deprecated]
Time Series - Time series toolkit for Julia.
Sampling - Basic sampling algorithms for Julia.

Misc Stuff / Presentations

DSP - Digital Signal Processing (filtering, periodograms, spectrograms, window functions).
JuliaCon Presentations - Presentations for JuliaCon.
SignalProcessing - Signal Processing tools for Julia.
Images - An image library for Julia.
DataDeps - Reproducible data setup for reproducible science.

Lua

General-Purpose Machine Learning

Torch7
- cephes - Cephes mathematical functions library, wrapped for Torch. Provides and wraps the 180+ special mathematical functions from the Cephes mathematical library, developed by Stephen L. Moshier. It is used, among many other places, at the heart of SciPy. [Deprecated]
- autograd - Autograd automatically differentiates native Torch code. Inspired by the original Python version.
- graph - Graph package for Torch. [Deprecated]
- randomkit - Numpy's randomkit, wrapped for Torch. [Deprecated]
- signal - A signal processing toolbox for Torch-7. FFT, DCT, Hilbert, cepstrums, stft.
- nn - Neural Network package for Torch.
- torchnet - framework for torch which provides a set of abstractions aiming at encouraging code re-use as well as encouraging modular programming.
- nngraph - This package provides graphical computation for nn library in Torch7.
- nnx - A completely unstable and experimental package that extends Torch's builtin nn library.
- rnn - A Recurrent Neural Network library that extends Torch's nn. RNNs, LSTMs, GRUs, BRNNs, BLSTMs, etc.
- dpnn - Many useful features that aren't part of the main nn package.
- dp - A deep learning library designed for streamlining research and development using the Torch7 distribution. It emphasizes flexibility through the elegant use of object-oriented design patterns. [Deprecated]
- optim - An optimization library for Torch. SGD, Adagrad, Conjugate-Gradient, LBFGS, RProp and more.
- unsup - A package for unsupervised learning in Torch. Provides modules that are compatible with nn (LinearPsd, ConvPsd, AutoEncoder, ...), and self-contained algorithms (k-means, PCA). [Deprecated]
- manifold - A package to manipulate manifolds.
- svm - Torch-SVM library. [Deprecated]
- lbfgs - FFI Wrapper for liblbfgs. [Deprecated]
- vowpalwabbit - An old vowpalwabbit interface to torch. [Deprecated]
- OpenGM - OpenGM is a C++ library for graphical modeling, and inference. The Lua bindings provide a simple way of describing graphs, from Lua, and then optimizing them with OpenGM. [Deprecated]
- spaghetti - Spaghetti (sparse linear) module for torch7 by @MichaelMathieu [Deprecated]
- LuaSHKit - A lua wrapper around the Locality sensitive hashing library SHKit [Deprecated]
- kernel smoothing - KNN, kernel-weighted average, local linear regression smoothers. [Deprecated]
- cutorch - Torch CUDA Implementation.
- cunn - Torch CUDA Neural Network Implementation.
- imgraph - An image/graph library for Torch. This package provides routines to construct graphs on images, segment them, build trees out of them, and convert them back to images. [Deprecated]
- videograph - A video/graph library for Torch. This package provides routines to construct graphs on videos, segment them, build trees out of them, and convert them back to videos. [Deprecated]
- saliency - code and tools around integral images. A library for finding interest points based on fast integral histograms. [Deprecated]
- stitch - allows us to use hugin to stitch images and apply same stitching to a video sequence. [Deprecated]
- sfm - A bundle adjustment/structure from motion package. [Deprecated]
- fex - A package for feature extraction in Torch. Provides SIFT and dSIFT modules. [Deprecated]
- OverFeat - A state-of-the-art generic dense feature extractor. [Deprecated]
- wav2letter - a simple and efficient end-to-end Automatic Speech Recognition (ASR) system from Facebook AI Research.
Numeric Lua
Lunatic Python
SciLua
Lua - Numerical Algorithms [Deprecated]
Lunum [Deprecated]

Demos and Scripts

Core torch7 demos repository.
- linear-regression, logistic-regression
- face detector (training and detection as separate demos)
- mst-based-segmenter
- train-a-digit-classifier
- train-autoencoder
- optical flow demo
- train-on-housenumbers
- train-on-cifar
- tracking with deep nets
- kinect demo
- filter-bank visualization
- saliency-networks
Training a Convnet for the Galaxy-Zoo Kaggle challenge(CUDA demo)
Music Tagging - Music Tagging scripts for torch7.
torch-datasets - Scripts to load several popular datasets including:
- BSR 500
- CIFAR-10
- COIL
- Street View House Numbers
- MNIST
- NORB
Atari2600 - Scripts to generate a dataset with static frames from the Arcade Learning Environment.

Matlab

Computer Vision

Contourlets - MATLAB source code that implements the contourlet transform and its utility functions.
Shearlets - MATLAB code for shearlet transform.
Curvelets - The Curvelet transform is a higher dimensional generalization of the Wavelet transform designed to represent images at different scales and different angles.
Bandlets - MATLAB code for bandlet transform.
mexopencv - Collection and a development kit of MATLAB mex functions for OpenCV library.

Natural Language Processing

NLP - An NLP library for Matlab.

General-Purpose Machine Learning

Training a deep autoencoder or a classifier on MNIST digits - Training a deep autoencoder or a classifier on MNIST digits[DEEP LEARNING].
Convolutional-Recursive Deep Learning for 3D Object Classification - Convolutional-Recursive Deep Learning for 3D Object Classification[DEEP LEARNING].
Spider - The spider is intended to be a complete object orientated environment for machine learning in Matlab.
LibSVM - A Library for Support Vector Machines.
ThunderSVM - An Open-Source SVM Library on GPUs and CPUs
LibLinear - A Library for Large Linear Classification.
Machine Learning Module - Class on machine w/ PDF, lectures, code
Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind.
Pattern Recognition Toolbox - A complete object-oriented environment for machine learning in Matlab.
Pattern Recognition and Machine Learning - This package contains the matlab implementation of the algorithms described in the book Pattern Recognition and Machine Learning by C. Bishop.
Optunity - A library dedicated to automated hyperparameter optimization with a simple, lightweight API to facilitate drop-in replacement of grid search. Optunity is written in Python but interfaces seamlessly with MATLAB.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
Machine Learning in MatLab/Octave - examples of popular machine learning algorithms (neural networks, linear/logistic regressions, K-Means, etc.) with code examples and mathematics behind them being explained.

Data Analysis / Data Visualization

matlab_bgl - MatlabBGL is a Matlab package for working with graphs.
gaimc - Efficient pure-Matlab implementations of graph algorithms to complement MatlabBGL's mex functions.

.NET

Computer Vision

OpenCVDotNet - A wrapper for the OpenCV project to be used with .NET applications.
Emgu CV - Cross platform wrapper of OpenCV which can be compiled in Mono to be run on Windows, Linus, Mac OS X, iOS, and Android.
AForge.NET - Open source C# framework for developers and researchers in the fields of Computer Vision and Artificial Intelligence. Development has now shifted to GitHub.
Accord.NET - Together with AForge.NET, this library can provide image processing and computer vision algorithms to Windows, Windows RT and Windows Phone. Some components are also available for Java and Android.

Natural Language Processing

Stanford.NLP for .NET - A full port of Stanford NLP packages to .NET and also available precompiled as a NuGet package.

General-Purpose Machine Learning

Accord-Framework -The Accord.NET Framework is a complete framework for building machine learning, computer vision, computer audition, signal processing and statistical applications.
Accord.MachineLearning - Support Vector Machines, Decision Trees, Naive Bayesian models, K-means, Gaussian Mixture models and general algorithms such as Ransac, Cross-validation and Grid-Search for machine-learning applications. This package is part of the Accord.NET Framework.
DiffSharp - An automatic differentiation (AD) library providing exact and efficient derivatives (gradients, Hessians, Jacobians, directional derivatives, and matrix-free Hessian- and Jacobian-vector products) for machine learning and optimization applications. Operations can be nested to any level, meaning that you can compute exact higher-order derivatives and differentiate functions that are internally making use of differentiation, for applications such as hyperparameter optimization.
Encog - An advanced neural network and machine learning framework. Encog contains classes to create a wide variety of networks, as well as support classes to normalize and process data for these neural networks. Encog trains using multithreaded resilient propagation. Encog can also make use of a GPU to further speed processing time. A GUI based workbench is also provided to help model and train neural networks.
GeneticSharp - Multi-platform genetic algorithm library for .NET Core and .NET Framework. The library has several implementations of GA operators, like: selection, crossover, mutation, reinsertion and termination.
Infer.NET - Infer.NET is a framework for running Bayesian inference in graphical models. One can use Infer.NET to solve many different kinds of machine learning problems, from standard problems like classification, recommendation or clustering through to customised solutions to domain-specific problems. Infer.NET has been used in a wide variety of domains including information retrieval, bioinformatics, epidemiology, vision, and many others.
ML.NET - ML.NET is a cross-platform open-source machine learning framework which makes machine learning accessible to .NET developers. ML.NET was originally developed in Microsoft Research and evolved into a significant framework over the last decade and is used across many product groups in Microsoft like Windows, Bing, PowerPoint, Excel and more.
Neural Network Designer - DBMS management system and designer for neural networks. The designer application is developed using WPF, and is a user interface which allows you to design your neural network, query the network, create and configure chat bots that are capable of asking questions and learning from your feed back. The chat bots can even scrape the internet for information to return in their output as well as to use for learning.
Vulpes - Deep belief and deep learning implementation written in F# and leverages CUDA GPU execution with Alea.cuBase.

Data Analysis / Data Visualization

numl - numl is a machine learning library intended to ease the use of using standard modeling techniques for both prediction and clustering.
Math.NET Numerics - Numerical foundation of the Math.NET project, aiming to provide methods and algorithms for numerical computations in science, engineering and every day use. Supports .Net 4.0, .Net 3.5 and Mono on Windows, Linux and Mac; Silverlight 5, WindowsPhone/SL 8, WindowsPhone 8.1 and Windows 8 with PCL Portable Profiles 47 and 344; Android/iOS with Xamarin.
Sho - Sho is an interactive environment for data analysis and scientific computing that lets you seamlessly connect scripts (in IronPython) with compiled code (in .NET) to enable fast and flexible prototyping. The environment includes powerful and efficient libraries for linear algebra as well as data visualization that can be used from any .NET language, as well as a feature-rich interactive shell for rapid development.

Objective C

General-Purpose Machine Learning

YCML - A Machine Learning framework for Objective-C and Swift (OS X / iOS).
MLPNeuralNet - Fast multilayer perceptron neural network library for iOS and Mac OS X. MLPNeuralNet predicts new examples by trained neural network. It is built on top of the Apple's Accelerate Framework, using vectorized operations and hardware acceleration if available. [Deprecated]
MAChineLearning - An Objective-C multilayer perceptron library, with full support for training through backpropagation. Implemented using vDSP and vecLib, it's 20 times faster than its Java equivalent. Includes sample code for use from Swift.
BPN-NeuralNetwork - It implemented 3 layers neural network ( Input Layer, Hidden Layer and Output Layer ) and it named Back Propagation Neural Network (BPN). This network can be used in products recommendation, user behavior analysis, data mining and data analysis. [Deprecated]
Multi-Perceptron-NeuralNetwork - it implemented multi-perceptrons neural network (ニューラルネットワーク) based on Back Propagation Neural Network (BPN) and designed unlimited-hidden-layers.
KRHebbian-Algorithm - It is a non-supervisor and self-learning algorithm (adjust the weights) in neural network of Machine Learning. [Deprecated]
KRKmeans-Algorithm - It implemented K-Means the clustering and classification algorithm. It could be used in data mining and image compression. [Deprecated]
KRFuzzyCMeans-Algorithm - It implemented Fuzzy C-Means (FCM) the fuzzy clustering / classification algorithm on Machine Learning. It could be used in data mining and image compression. [Deprecated]

OCaml

General-Purpose Machine Learning

Oml - A general statistics and machine learning library.
GPR - Efficient Gaussian Process Regression in OCaml.
Libra-Tk - Algorithms for learning and inference with discrete probabilistic models.
TensorFlow - OCaml bindings for TensorFlow.

Perl

Data Analysis / Data Visualization

Perl Data Language, a pluggable architecture for data and image processing, which can be used for machine learning.

General-Purpose Machine Learning

MXnet for Deep Learning, in Perl, also released in CPAN.
Perl Data Language, using AWS machine learning platform from Perl.
Algorithm::SVMLight, implementation of Support Vector Machines with SVMLight under it. [Deprecated]
Several machine learning and artificial intelligence models are included in the AI namespace. For instance, you can find Naïve Bayes.

Perl 6

Data Analysis / Data Visualization

Perl Data Language, a pluggable architecture for data and image processing, which can be used for machine learning.

General-Purpose Machine Learning

PHP

Natural Language Processing

jieba-php - Chinese Words Segmentation Utilities.

General-Purpose Machine Learning

PHP-ML - Machine Learning library for PHP. Algorithms, Cross Validation, Neural Network, Preprocessing, Feature Extraction and much more in one library.
PredictionBuilder - A library for machine learning that builds predictions using a linear regression.
Rubix ML - A high-level machine learning (ML) library that lets you build programs that learn from data using the PHP language.
19 Questions - A machine learning / bayesian inference assigning attributes to objects.

Python

Computer Vision

Scikit-Image - A collection of algorithms for image processing in Python.
SimpleCV - An open source computer vision framework that gives access to several high-powered computer vision libraries, such as OpenCV. Written on Python and runs on Mac, Windows, and Ubuntu Linux.
Vigranumpy - Python bindings for the VIGRA C++ computer vision library.
OpenFace - Free and open source face recognition with deep neural networks.
PCV - Open source Python module for computer vision. [Deprecated]
face_recognition - Face recognition library that recognize and manipulate faces from Python or from the command line.
dockerface - Easy to install and use deep learning Faster R-CNN face detection for images and video in a docker container.
Detectron - FAIR's software system that implements state-of-the-art object detection algorithms, including Mask R-CNN. It is written in Python and powered by the Caffe2 deep learning framework.
albumentations - А fast and framework agnostic image augmentation library that implements a diverse set of augmentation techniques. Supports classification, segmentation, detection out of the box. Was used to win a number of Deep Learning competitions at Kaggle, Topcoder and those that were a part of the CVPR workshops.
pytessarct - Python-tesseract is an optical character recognition (OCR) tool for python. That is, it will recognize and "read" the text embedded in images.Python-tesseract is a wrapper for Google's Tesseract-OCR Engine>.
imutils - A library containg Convenience functions to make basic image processing operations such as translation, rotation, resizing, skeletonization, and displaying Matplotlib images easier with OpenCV and Python.
PyTorchCV - A PyTorch-Based Framework for Deep Learning in Computer Vision.

Natural Language Processing

pkuseg-python - A better version of Jieba, developed by Peking University.
NLTK - A leading platform for building Python programs to work with human language data.
Pattern - A web mining module for the Python programming language. It has tools for natural language processing, machine learning, among others.
Quepy - A python framework to transform natural language questions to queries in a database query language.
TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of NLTK and Pattern, and plays nicely with both.
YAlign - A sentence aligner, a friendly tool for extracting parallel sentences from comparable corpora. [Deprecated]
jieba - Chinese Words Segmentation Utilities.
SnowNLP - A library for processing Chinese text.
spammy - A library for email Spam filtering built on top of nltk
loso - Another Chinese segmentation library. [Deprecated]
genius - A Chinese segment base on Conditional Random Field.
KoNLPy - A Python package for Korean natural language processing.
nut - Natural language Understanding Toolkit. [Deprecated]
Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
BLLIP Parser - Python bindings for the BLLIP Natural Language Parser (also known as the Charniak-Johnson parser). [Deprecated]
PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python. Also contains some specific modules for parsing common NLP formats, most notably for FoLiA, but also ARPA language models, Moses phrasetables, GIZA++ alignments.
python-ucto - Python binding to ucto (a unicode-aware rule-based tokenizer for various languages).
python-frog - Python binding to Frog, an NLP suite for Dutch. (pos tagging, lemmatisation, dependency parsing, NER)
python-zpar - Python bindings for ZPar, a statistical part-of-speech-tagger, constiuency parser, and dependency parser for English.
colibri-core - Python binding to C++ library for extracting and working with with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
spaCy - Industrial strength NLP with Python and Cython.
PyStanfordDependencies - Python interface for converting Penn Treebank trees to Stanford Dependencies.
Distance - Levenshtein and Hamming distance computation. [Deprecated]
Fuzzy Wuzzy - Fuzzy String Matching in Python.
jellyfish - a python library for doing approximate and phonetic matching of strings.
editdistance - fast implementation of edit distance.
textacy - higher-level NLP built on Spacy.
stanford-corenlp-python - Python wrapper for Stanford CoreNLP [Deprecated]
CLTK - The Classical Language Toolkit.
rasa_nlu - turn natural language into structured data.
yase - Transcode sentence (or other sequence) to list of word vector .
Polyglot - Multilingual text (NLP) processing toolkit.
DrQA - Reading Wikipedia to answer open-domain questions.
Dedupe - A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
Snips NLU - Natural Language Understanding library for intent classification and entity extraction
NeuroNER - Named-entity recognition using neural networks providing state-of-the-art-results
DeepPavlov - conversational AI library with many pretrained Russian NLP models.
BigARTM - topic modelling platform.

General-Purpose Machine Learning

PyOD -> Python Outlier Detection, comprehensive and scalable Python toolkit for detecting outlying objects in multivariate data. Featured for Advanced models, including Neural Networks/Deep Learning and Outlier Ensembles.
steppy -> Lightweight, Python library for fast and reproducible machine learning experimentation. Introduces very simple interface that enables clean machine learning pipeline design.
steppy-toolkit -> Curated collection of the neural networks, transformers and models that make your machine learning work faster and more effective.
CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit. Documentation can be found here.
auto_ml - Automated machine learning for production and analytics. Lets you focus on the fun parts of ML, while outputting production-ready code, and detailed analytics of your dataset and results. Includes support for NLP, XGBoost, CatBoost, LightGBM, and soon, deep learning.
machine learning - automated build consisting of a web-interface, and set of programmatic-interface API, for support vector machines. Corresponding dataset(s) are stored into a SQL database, then generated model(s) used for prediction(s), are stored into a NoSQL datastore.
XGBoost - Python bindings for eXtreme Gradient Boosting (Tree) Library.
Apache SINGA - An Apache Incubating project for developing an open source machine learning library.
Bayesian Methods for Hackers - Book/iPython notebooks on Probabilistic Programming in Python.
Featureforge A set of tools for creating and testing machine learning features, with a scikit-learn compatible API.
MLlib in Apache Spark - Distributed machine learning library in Spark
Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
scikit-learn - A Python module for machine learning built on top of SciPy.
metric-learn - A Python module for metric learning.
SimpleAI Python implementation of many of the artificial intelligence algorithms described on the book "Artificial Intelligence, a Modern Approach". It focuses on providing an easy to use, well documented and tested library.
astroML - Machine Learning and Data Mining for Astronomy.
graphlab-create - A library with various machine learning models (regression, clustering, recommender systems, graph analytics, etc.) implemented on top of a disk-backed DataFrame.
BigML - A library that contacts external servers.
pattern - Web mining module for Python.
NuPIC - Numenta Platform for Intelligent Computing.
Pylearn2 - A Machine Learning library based on Theano.
keras - High-level neural networks frontend for TensorFlow, CNTK and Theano.
Lasagne - Lightweight library to build and train neural networks in Theano.
hebel - GPU-Accelerated Deep Learning Library in Python. [Deprecated]
Chainer - Flexible neural network framework.
prophet - Fast and automated time series forecasting framework by Facebook.
gensim - Topic Modelling for Humans.
topik - Topic modelling toolkit. [Deprecated]
PyBrain - Another Python Machine Learning Library.
Brainstorm - Fast, flexible and fun neural networks. This is the successor of PyBrain.
Surprise - A scikit for building and analyzing recommender systems.
Crab - A flexible, fast recommender engine. [Deprecated]
python-recsys - A Python library for implementing a Recommender System.
thinking bayes - Book on Bayesian Analysis.
Image-to-Image Translation with Conditional Adversarial Networks - Implementation of image to image (pix2pix) translation from the paper by isola et al.[DEEP LEARNING]
Restricted Boltzmann Machines -Restricted Boltzmann Machines in Python. [DEEP LEARNING]
Bolt - Bolt Online Learning Toolbox. [Deprecated]
CoverTree - Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree [Deprecated]
nilearn - Machine learning for NeuroImaging in Python.
neuropredict - Aimed at novice machine learners and non-expert programmers, this package offers easy (no coding needed) and comprehensive machine learning (evaluation and full report of predictive performance WITHOUT requiring you to code) in Python for NeuroImaging and any other type of features. This is aimed at absorbing the much of the ML workflow, unlike other packages like nilearn and pymvpa, which require you to learn their API and code to produce anything useful.
imbalanced-learn - Python module to perform under sampling and over sampling with various techniques.
Shogun - The Shogun Machine Learning Toolbox.
Pyevolve - Genetic algorithm framework. [Deprecated]
Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind.
breze - Theano based library for deep and recurrent neural networks. [Deprecated]
pyhsmm - library for approximate unsupervised inference in Bayesian Hidden Markov Models (HMMs) and explicit-duration Hidden semi-Markov Models (HSMMs), focusing on the Bayesian Nonparametric extensions, the HDP-HMM and HDP-HSMM, mostly with weak-limit approximations.
mrjob - A library to let Python program run on Hadoop.
SKLL - A wrapper around scikit-learn that makes it simpler to conduct experiments.
neurolab
Spearmint - Spearmint is a package to perform Bayesian optimization according to the algorithms outlined in the paper: Practical Bayesian Optimization of Machine Learning Algorithms. Jasper Snoek, Hugo Larochelle and Ryan P. Adams. Advances in Neural Information Processing Systems, 2012. [Deprecated]
Pebl - Python Environment for Bayesian Learning. [Deprecated]
Theano - Optimizing GPU-meta-programming code generating array oriented optimizing math compiler in Python.
TensorFlow - Open source software library for numerical computation using data flow graphs.
pomegranate - Hidden Markov Models for Python, implemented in Cython for speed and efficiency.
python-timbl - A Python extension module wrapping the full TiMBL C++ programming interface. Timbl is an elaborate k-Nearest Neighbours machine learning toolkit.
deap - Evolutionary algorithm framework.
pydeep - Deep Learning In Python. [Deprecated]
mlxtend - A library consisting of useful tools for data science and machine learning tasks.
neon - Nervana's high-performance Python-based Deep Learning framework [DEEP LEARNING].
Optunity - A library dedicated to automated hyperparameter optimization with a simple, lightweight API to facilitate drop-in replacement of grid search.
Neural Networks and Deep Learning - Code samples for my book "Neural Networks and Deep Learning" [DEEP LEARNING].
Annoy - Approximate nearest neighbours implementation.
TPOT - Tool that automatically creates and optimizes machine learning pipelines using genetic programming. Consider it your personal data science assistant, automating a tedious part of machine learning.
pgmpy A python library for working with Probabilistic Graphical Models.
DIGITS - The Deep Learning GPU Training System (DIGITS) is a web application for training deep learning models.
Orange - Open source data visualization and data analysis for novices and experts.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
milk - Machine learning toolkit focused on supervised classification. [Deprecated]
TFLearn - Deep learning library featuring a higher-level API for TensorFlow.
REP - an IPython-based environment for conducting data-driven research in a consistent and reproducible way. REP is not trying to substitute scikit-learn, but extends it and provides better user experience. [Deprecated]
rgf_python - Python bindings for Regularized Greedy Forest (Tree) Library.
skbayes - Python package for Bayesian Machine Learning with scikit-learn API.
fuku-ml - Simple machine learning library, including Perceptron, Regression, Support Vector Machine, Decision Tree and more, it's easy to use and easy to learn for beginners.
Xcessiv - A web-based application for quick, scalable, and automated hyperparameter tuning and stacked ensembling.
PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
ML-From-Scratch - Implementations of Machine Learning models from scratch in Python with a focus on transparency. Aims to showcase the nuts and bolts of ML in an accessible way.
Edward - A library for probabilistic modeling, inference, and criticism. Built on top of TensorFlow.
xRBM - A library for Restricted Boltzmann Machine (RBM) and its conditional variants in Tensorflow.
CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box. It is easy to install, well documented and supports CPU and GPU (even multi-GPU) computation.
stacked_generalization - Implementation of machine learning stacking technic as handy library in Python.
modAL - A modular active learning framework for Python, built on top of scikit-learn.
Cogitare: A Modern, Fast, and Modular Deep Learning and Machine Learning framework for Python.
Parris - Parris, the automated infrastructure setup tool for machine learning algorithms.
neonrvm - neonrvm is an open source machine learning library based on RVM technique. It's written in C programming language and comes with Python programming language bindings.
Turi Create - Machine learning from Apple. Turi Create simplifies the development of custom machine learning models. You don't have to be a machine learning expert to add recommendations, object detection, image classification, image similarity or activity classification to your app.
xLearn - A high performance, easy-to-use, and scalable machine learning package, which can be used to solve large-scale machine learning problems. xLearn is especially useful for solving machine learning problems on large-scale sparse data, which is very common in Internet services such as online advertisement and recommender systems.
mlens - A high performance, memory efficient, maximally parallelized ensemble learning, integrated with scikit-learn.
Netron - Visualizer for machine learning models.
Thampi - Machine Learning Prediction System on AWS Lambda
MindsDB - Open Source framework to streamline use of neural networks.
Microsoft Recommenders: Examples and best practices for building recommendation systems, provided as Jupyter notebooks. The repo contains some of the latest state of the art algorithms from Microsoft Research as well as from other companies and institutions.
StellarGraph: Machine Learning on Graphs, a Python library for machine learning on graph-structured (network-structured) data.
BentoML: Toolkit for package and deploy machine learning models for serving in production
MiraiML: An asynchronous engine for continuous & autonomous machine learning, built for real-time usage.
numpy-ML: Reference implementations of ML models written in numpy
creme: A framework for online machine learning.
Neuraxle: A framework providing the right abstractions to ease research, development, and deployment of your ML pipelines.

Data Analysis / Data Visualization

SciPy - A Python-based ecosystem of open-source software for mathematics, science, and engineering.
NumPy - A fundamental package for scientific computing with Python.
Numba - Python JIT (just in time) compiler to LLVM aimed at scientific Python by the developers of Cython and NumPy.
Mars - A tensor-based framework for large-scale data computation which often regarded as a parallel and distributed version of NumPy.
NetworkX - A high-productivity software for complex networks.
igraph - binding to igraph library - General purpose graph library.
Pandas - A library providing high-performance, easy-to-use data structures and data analysis tools.
Open Mining - Business Intelligence (BI) in Python (Pandas web interface) [Deprecated]
PyMC - Markov Chain Monte Carlo sampling toolkit.
zipline - A Pythonic algorithmic trading library.
PyDy - Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion based around NumPy, SciPy, IPython, and matplotlib.
SymPy - A Python library for symbolic mathematics.
statsmodels - Statistical modeling and econometrics in Python.
astropy - A community Python library for Astronomy.
matplotlib - A Python 2D plotting library.
bokeh - Interactive Web Plotting for Python.
plotly - Collaborative web plotting for Python and matplotlib.
altair - A Python to Vega translator.
d3py - A plotting library for Python, based on D3.js.
PyDexter - Simple plotting for Python. Wrapper for D3xterjs; easily render charts in-browser.
ggplot - Same API as ggplot2 for R. [Deprecated]
ggfortify - Unified interface to ggplot2 popular R packages.
Kartograph.py - Rendering beautiful SVG maps in Python.
pygal - A Python SVG Charts Creator.
PyQtGraph - A pure-python graphics and GUI library built on PyQt4 / PySide and NumPy.
pycascading [Deprecated]
Petrel - Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python.
Blaze - NumPy and Pandas interface to Big Data.
emcee - The Python ensemble sampling toolkit for affine-invariant MCMC.
windML - A Python Framework for Wind Energy Analysis and Prediction.
vispy - GPU-based high-performance interactive OpenGL 2D/3D data visualization library.
cerebro2 A web-based visualization and debugging platform for NuPIC. [Deprecated]
NuPIC Studio An all-in-one NuPIC Hierarchical Temporal Memory visualization and debugging super-tool! [Deprecated]
SparklingPandas Pandas on PySpark (POPS).
Seaborn - A python visualization library based on matplotlib.
bqplot - An API for plotting in Jupyter (IPython).
pastalog - Simple, realtime visualization of neural network training performance.
Superset - A data exploration platform designed to be visual, intuitive, and interactive.
Dora - Tools for exploratory data analysis in Python.
Ruffus - Computation Pipeline library for python.
SOMPY - Self Organizing Map written in Python (Uses neural networks for data analysis).
somoclu Massively parallel self-organizing maps: accelerate training on multicore CPUs, GPUs, and clusters, has python API.
HDBScan - implementation of the hdbscan algorithm in Python - used for clustering
visualize_ML - A python package for data exploration and data analysis. [Deprecated]
scikit-plot - A visualization library for quick and easy generation of common plots in data analysis and machine learning.
Bowtie - A dashboard library for interactive visualizations using flask socketio and react.
lime - Lime is about explaining what machine learning classifiers (or models) are doing. It is able to explain any black box classifier, with two or more classes.
PyCM - PyCM is a multi-class confusion matrix library written in Python that supports both input data vectors and direct matrix, and a proper tool for post-classification model evaluation that supports most classes and overall statistics parameters
Dash - A framework for creating analytical web applications built on top of Plotly.js, React, and Flask
Lambdo - A workflow engine for solving machine learning problems by combining in one analysis pipeline (i) feature engineering and machine learning (ii) model training and prediction (iii) table population and column evaluation via user-defined (Python) functions.
TensorWatch - Debugging and visualization tool for machine learning and data science. It extensively leverages Jupyter Notebook to show real-time visualizations of data in running processes such as machine learning training.

Misc Scripts / iPython Notebooks / Codebases

Map/Reduce implementations of common ML algorithms: Jupyter notebooks that cover how to implement from scratch different ML algorithms (ordinary least squares, gradient descent, k-means, alternating least squares), using Python NumPy, and how to then make these implementations scalable using Map/Reduce and Spark.
BioPy - Biologically-Inspired and Machine Learning Algorithms in Python. [Deprecated]
SVM Explorer - Interactive SVM Explorer, using Dash and scikit-learn
pattern_classification
thinking stats 2
hyperopt
numpic
2012-paper-diginorm
A gallery of interesting IPython notebooks
ipython-notebooks
data-science-ipython-notebooks - Continually updated Data Science Python Notebooks: Spark, Hadoop MapReduce, HDFS, AWS, Kaggle, scikit-learn, matplotlib, pandas, NumPy, SciPy, and various command lines.
decision-weights
Sarah Palin LDA - Topic Modeling the Sarah Palin emails.
Diffusion Segmentation - A collection of image segmentation algorithms based on diffusion methods.
Scipy Tutorials - SciPy tutorials. This is outdated, check out scipy-lecture-notes.
Crab - A recommendation engine library for Python.
BayesPy - Bayesian Inference Tools in Python.
scikit-learn tutorials - Series of notebooks for learning scikit-learn.
sentiment-analyzer - Tweets Sentiment Analyzer
sentiment_classifier - Sentiment classifier using word sense disambiguation.
group-lasso - Some experiments with the coordinate descent algorithm used in the (Sparse) Group Lasso model.
jProcessing - Kanji / Hiragana / Katakana to Romaji Converter. Edict Dictionary & parallel sentences Search. Sentence Similarity between two JP Sentences. Sentiment Analysis of Japanese Text. Run Cabocha(ISO--8859-1 configured) in Python.
mne-python-notebooks - IPython notebooks for EEG/MEG data processing using mne-python.
Neon Course - IPython notebooks for a complete course around understanding Nervana's Neon.
pandas cookbook - Recipes for using Python's pandas library.
climin - Optimization library focused on machine learning, pythonic implementations of gradient descent, LBFGS, rmsprop, adadelta and others.
Allen Downey’s Data Science Course - Code for Data Science at Olin College, Spring 2014.
Allen Downey’s Think Bayes Code - Code repository for Think Bayes.
Allen Downey’s Think Complexity Code - Code for Allen Downey's book Think Complexity.
Allen Downey’s Think OS Code - Text and supporting code for Think OS: A Brief Introduction to Operating Systems.
Python Programming for the Humanities - Course for Python programming for the Humanities, assuming no prior knowledge. Heavy focus on text processing / NLP.
GreatCircle - Library for calculating great circle distance.
Optunity examples - Examples demonstrating how to use Optunity in synergy with machine learning libraries.
Dive into Machine Learning with Python Jupyter notebook and scikit-learn - "I learned Python by hacking first, and getting serious later. I wanted to do this with Machine Learning. If this is your style, join me in getting a bit ahead of yourself."
TDB - TensorDebugger (TDB) is a visual debugger for deep learning. It features interactive, node-by-node debugging and visualization for TensorFlow.
Suiron - Machine Learning for RC Cars.
Introduction to machine learning with scikit-learn - IPython notebooks from Data School's video tutorials on scikit-learn.
Practical XGBoost in Python - comprehensive online course about using XGBoost in Python.
Introduction to Machine Learning with Python - Notebooks and code for the book "Introduction to Machine Learning with Python"
Pydata book - Materials and IPython notebooks for "Python for Data Analysis" by Wes McKinney, published by O'Reilly Media
Homemade Machine Learning - Python examples of popular machine learning algorithms with interactive Jupyter demos and math being explained
Prodmodel - Build tool for data science pipelines.
the-elements-of-statistical-learning - This repository contains Jupyter notebooks implementing the algorithms found in the book and summary of the textbook.

Neural Networks

nn_builder - nn_builder is a python package that lets you build neural networks in 1 line
NeuralTalk - NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
Neuron - Neuron is simple class for time series predictions. It's utilize LNU (Linear Neural Unit), QNU (Quadratic Neural Unit), RBF (Radial Basis Function), MLP (Multi Layer Perceptron), MLP-ELM (Multi Layer Perceptron - Extreme Learning Machine) neural networks learned with Gradient descent or LeLevenberg–Marquardt algorithm. =======
NeuralTalk - NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences. [Deprecated]
Neuron - Neuron is simple class for time series predictions. It's utilize LNU (Linear Neural Unit), QNU (Quadratic Neural Unit), RBF (Radial Basis Function), MLP (Multi Layer Perceptron), MLP-ELM (Multi Layer Perceptron - Extreme Learning Machine) neural networks learned with Gradient descent or LeLevenberg–Marquardt algorithm. [Deprecated]
Data Driven Code - Very simple implementation of neural networks for dummies in python without using any libraries, with detailed comments.

Kaggle Competition Source Code

open-solution-home-credit -> source code and experiments results for Home Credit Default Risk.
open-solution-googleai-object-detection -> source code and experiments results for Google AI Open Images - Object Detection Track.
open-solution-salt-identification -> source code and experiments results for TGS Salt Identification Challenge.
open-solution-ship-detection -> source code and experiments results for Airbus Ship Detection Challenge.
open-solution-data-science-bowl-2018 -> source code and experiments results for 2018 Data Science Bowl.
open-solution-value-prediction -> source code and experiments results for Santander Value Prediction Challenge.
open-solution-toxic-comments -> source code for Toxic Comment Classification Challenge.
wiki challenge - An implementation of Dell Zhang's solution to Wikipedia's Participation Challenge on Kaggle.
kaggle insults - Kaggle Submission for "Detecting Insults in Social Commentary".
kaggle_acquire-valued-shoppers-challenge - Code for the Kaggle acquire valued shoppers challenge.
kaggle-cifar - Code for the CIFAR-10 competition at Kaggle, uses cuda-convnet.
kaggle-blackbox - Deep learning made easy.
kaggle-accelerometer - Code for Accelerometer Biometric Competition at Kaggle.
kaggle-advertised-salaries - Predicting job salaries from ads - a Kaggle competition.
kaggle amazon - Amazon access control challenge.
kaggle-bestbuy_big - Code for the Best Buy competition at Kaggle.
kaggle-bestbuy_small
Kaggle Dogs vs. Cats - Code for Kaggle Dogs vs. Cats competition.
Kaggle Galaxy Challenge - Winning solution for the Galaxy Challenge on Kaggle.
Kaggle Gender - A Kaggle competition: discriminate gender based on handwriting.
Kaggle Merck - Merck challenge at Kaggle.
Kaggle Stackoverflow - Predicting closed questions on Stack Overflow.
kaggle_acquire-valued-shoppers-challenge - Code for the Kaggle acquire valued shoppers challenge.
wine-quality - Predicting wine quality.

Reinforcement Learning

DeepMind Lab - DeepMind Lab is a 3D learning environment based on id Software's Quake III Arena via ioquake3 and other open source software. Its primary purpose is to act as a testbed for research in artificial intelligence, especially deep reinforcement learning.
Gym - OpenAI Gym is a toolkit for developing and comparing reinforcement learning algorithms.
Serpent.AI - Serpent.AI is a game agent framework that allows you to turn any video game you own into a sandbox to develop AI and machine learning experiments. For both researchers and hobbyists.
ViZDoom - ViZDoom allows developing AI bots that play Doom using only the visual information (the screen buffer). It is primarily intended for research in machine visual learning, and deep reinforcement learning, in particular.
Roboschool - Open-source software for robot simulation, integrated with OpenAI Gym.
Retro - Retro Games in Gym
SLM Lab - Modular Deep Reinforcement Learning framework in PyTorch.
Coach - Reinforcement Learning Coach by Intel® AI Lab enables easy experimentation with state of the art Reinforcement Learning algorithms

Ruby

Natural Language Processing

Awesome NLP with Ruby - Curated link list for practical natural language processing in Ruby.
Treat - Text REtrieval and Annotation Toolkit, definitely the most comprehensive toolkit I’ve encountered so far for Ruby.
Stemmer - Expose libstemmer_c to Ruby. [Deprecated]
Raspel - raspell is an interface binding for ruby. [Deprecated]
UEA Stemmer - Ruby port of UEALite Stemmer - a conservative stemmer for search and indexing.
Twitter-text-rb - A library that does auto linking and extraction of usernames, lists and hashtags in tweets.

General-Purpose Machine Learning

Awesome Machine Learning with Ruby - Curated list of ML related resources for Ruby.
Ruby Machine Learning - Some Machine Learning algorithms, implemented in Ruby. [Deprecated]
Machine Learning Ruby [Deprecated]
jRuby Mahout - JRuby Mahout is a gem that unleashes the power of Apache Mahout in the world of JRuby. [Deprecated]
CardMagic-Classifier - A general classifier module to allow Bayesian and other types of classifications.
rb-libsvm - Ruby language bindings for LIBSVM which is a Library for Support Vector Machines.
Scoruby - Creates Random Forest classifiers from PMML files.

Data Analysis / Data Visualization

rsruby - Ruby - R bridge.
data-visualization-ruby - Source code and supporting content for my Ruby Manor presentation on Data Visualisation with Ruby. [Deprecated]
ruby-plot - gnuplot wrapper for Ruby, especially for plotting ROC curves into SVG files. [Deprecated]
plot-rb - A plotting library in Ruby built on top of Vega and D3. [Deprecated]
scruffy - A beautiful graphing toolkit for Ruby.
SciRuby
Glean - A data management tool for humans. [Deprecated]
Bioruby
Arel [Deprecated]

Misc

Big Data For Chimps
Listof - Community based data collection, packed in gem. Get list of pretty much anything (stop words, countries, non words) in txt, json or hash. Demo/Search for a list

Rust

General-Purpose Machine Learning

deeplearn-rs - deeplearn-rs provides simple networks that use matrix multiplication, addition, and ReLU under the MIT license.
rustlearn - a machine learning framework featuring logistic regression, support vector machines, decision trees and random forests.
rusty-machine - a pure-rust machine learning library.
leaf - open source framework for machine intelligence, sharing concepts from TensorFlow and Caffe. Available under the MIT license. [Deprecated]
RustNN - RustNN is a feedforward neural network library. [Deprecated]
RusticSOM - A Rust library for Self Organising Maps (SOM).

R

General-Purpose Machine Learning

ahaz - ahaz: Regularization for semiparametric additive hazards regression. [Deprecated]
arules - arules: Mining Association Rules and Frequent Itemsets
biglasso - biglasso: Extending Lasso Model Fitting to Big Data in R.
bmrm - bmrm: Bundle Methods for Regularized Risk Minimization Package.
Boruta - Boruta: A wrapper algorithm for all-relevant feature selection.
bst - bst: Gradient Boosting.
C50 - C50: C5.0 Decision Trees and Rule-Based Models.
caret - Classification and Regression Training: Unified interface to ~150 ML algorithms in R.
caretEnsemble - caretEnsemble: Framework for fitting multiple caret models as well as creating ensembles of such models. [Deprecated]
CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box for R.
Clever Algorithms For Machine Learning
CORElearn - CORElearn: Classification, regression, feature evaluation and ordinal evaluation.
CoxBoost - CoxBoost: Cox models by likelihood based boosting for a single survival endpoint or competing risks [Deprecated]
Cubist - Cubist: Rule- and Instance-Based Regression Modeling.
e1071 - e1071: Misc Functions of the Department of Statistics (e1071), TU Wien
earth - earth: Multivariate Adaptive Regression Spline Models
elasticnet - elasticnet: Elastic-Net for Sparse Estimation and Sparse PCA.
ElemStatLearn - ElemStatLearn: Data sets, functions and examples from the book: "The Elements of Statistical Learning, Data Mining, Inference, and Prediction" by Trevor Hastie, Robert Tibshirani and Jerome Friedman Prediction" by Trevor Hastie, Robert Tibshirani and Jerome Friedman.
evtree - evtree: Evolutionary Learning of Globally Optimal Trees.
forecast - forecast: Timeseries forecasting using ARIMA, ETS, STLM, TBATS, and neural network models.
forecastHybrid - forecastHybrid: Automatic ensemble and cross validation of ARIMA, ETS, STLM, TBATS, and neural network models from the "forecast" package.
fpc - fpc: Flexible procedures for clustering.
frbs - frbs: Fuzzy Rule-based Systems for Classification and Regression Tasks. [Deprecated]
GAMBoost - GAMBoost: Generalized linear and additive models by likelihood based boosting. [Deprecated]
gamboostLSS - gamboostLSS: Boosting Methods for GAMLSS.
gbm - gbm: Generalized Boosted Regression Models.
glmnet - glmnet: Lasso and elastic-net regularized generalized linear models.
glmpath - glmpath: L1 Regularization Path for Generalized Linear Models and Cox Proportional Hazards Model.
GMMBoost - GMMBoost: Likelihood-based Boosting for Generalized mixed models. [Deprecated]
grplasso - grplasso: Fitting user specified models with Group Lasso penalty.
grpreg - grpreg: Regularization paths for regression models with grouped covariates.
h2o - A framework for fast, parallel, and distributed machine learning algorithms at scale -- Deeplearning, Random forests, GBM, KMeans, PCA, GLM.
hda - hda: Heteroscedastic Discriminant Analysis. [Deprecated]
Introduction to Statistical Learning
ipred - ipred: Improved Predictors.
kernlab - kernlab: Kernel-based Machine Learning Lab.
klaR - klaR: Classification and visualization.
L0Learn - L0Learn: Fast algorithms for best subset selection.
lars - lars: Least Angle Regression, Lasso and Forward Stagewise. [Deprecated]
lasso2 - lasso2: L1 constrained estimation aka ‘lasso’.
LiblineaR - LiblineaR: Linear Predictive Models Based On The Liblinear C/C++ Library.
LogicReg - LogicReg: Logic Regression.
Machine Learning For Hackers
maptree - maptree: Mapping, pruning, and graphing tree models. [Deprecated]
mboost - mboost: Model-Based Boosting.
medley - medley: Blending regression models, using a greedy stepwise approach.
mlr - mlr: Machine Learning in R.
ncvreg - ncvreg: Regularization paths for SCAD- and MCP-penalized regression models.
nnet - nnet: Feed-forward Neural Networks and Multinomial Log-Linear Models. [Deprecated]
pamr - pamr: Pam: prediction analysis for microarrays. [Deprecated]
party - party: A Laboratory for Recursive Partytioning.
partykit - partykit: A Toolkit for Recursive Partytioning.
penalized - penalized: L1 (lasso and fused lasso) and L2 (ridge) penalized estimation in GLMs and in the Cox model.
penalizedLDA - penalizedLDA: Penalized classification using Fisher's linear discriminant. [Deprecated]
penalizedSVM - penalizedSVM: Feature Selection SVM using penalty functions.
quantregForest - quantregForest: Quantile Regression Forests.
randomForest - randomForest: Breiman and Cutler's random forests for classification and regression.
randomForestSRC - randomForestSRC: Random Forests for Survival, Regression and Classification (RF-SRC).
rattle - rattle: Graphical user interface for data mining in R.
rda - rda: Shrunken Centroids Regularized Discriminant Analysis.
rdetools - rdetools: Relevant Dimension Estimation (RDE) in Feature Spaces. [Deprecated]
REEMtree - REEMtree: Regression Trees with Random Effects for Longitudinal (Panel) Data. [Deprecated]
relaxo - relaxo: Relaxed Lasso. [Deprecated]
rgenoud - rgenoud: R version of GENetic Optimization Using Derivatives
Rmalschains - Rmalschains: Continuous Optimization using Memetic Algorithms with Local Search Chains (MA-LS-Chains) in R.
rminer - rminer: Simpler use of data mining methods (e.g. NN and SVM) in classification and regression. [Deprecated]
ROCR - ROCR: Visualizing the performance of scoring classifiers. [Deprecated]
RoughSets - RoughSets: Data Analysis Using Rough Set and Fuzzy Rough Set Theories. [Deprecated]
rpart - rpart: Recursive Partitioning and Regression Trees.
RPMM - RPMM: Recursively Partitioned Mixture Model.
RSNNS - RSNNS: Neural Networks in R using the Stuttgart Neural Network Simulator (SNNS).
RWeka - RWeka: R/Weka interface.
RXshrink - RXshrink: Maximum Likelihood Shrinkage via Generalized Ridge or Least Angle Regression.
sda - sda: Shrinkage Discriminant Analysis and CAT Score Variable Selection. [Deprecated]
spectralGraphTopology - spectralGraphTopology: Learning Graphs from Data via Spectral Constraints.
SuperLearner - Multi-algorithm ensemble learning packages.
svmpath - svmpath: svmpath: the SVM Path algorithm. [Deprecated]
tgp - tgp: Bayesian treed Gaussian process models. [Deprecated]
tree - tree: Classification and regression trees.
varSelRF - varSelRF: Variable selection using random forests.
XGBoost.R - R binding for eXtreme Gradient Boosting (Tree) Library.
Optunity - A library dedicated to automated hyperparameter optimization with a simple, lightweight API to facilitate drop-in replacement of grid search. Optunity is written in Python but interfaces seamlessly to R.
igraph - binding to igraph library - General purpose graph library.
MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
TDSP-Utilities - Two data science utilities in R from Microsoft: 1) Interactive Data Exploration, Analysis, and Reporting (IDEAR) ; 2) Automated Modeling and Reporting (AMR).

Data Analysis / Data Visualization

ggplot2 - A data visualization package based on the grammar of graphics.
tmap for visualizing geospatial data with static maps and leaflet for interactive maps
tm and quanteda are the main packages for managing, analyzing, and visualizing textual data.
shiny is the basis for truly interactive displays and dashboards in R. However, some measure of interactivity can be achieved with htmlwidgets bringing javascript libraries to R. These include, plotly, dygraphs, highcharter, and several others.

SAS

General-Purpose Machine Learning

Visual Data Mining and Machine Learning - Interactive, automated, and programmatic modeling with the latest machine learning algorithms in and end-to-end analytics environment, from data prep to deployment. Free trial available.
Enterprise Miner - Data mining and machine learning that creates deployable models using a GUI or code.
Factory Miner - Automatically creates deployable machine learning models across numerous market or customer segments using a GUI.

Data Analysis / Data Visualization

SAS/STAT - For conducting advanced statistical analysis.
University Edition - FREE! Includes all SAS packages necessary for data analysis and visualization, and includes online SAS courses.

Natural Language Processing

Contextual Analysis - Add structure to unstructured text using a GUI.
Sentiment Analysis - Extract sentiment from text using a GUI.
Text Miner - Text mining using a GUI or code.

Demos and Scripts

ML_Tables - Concise cheat sheets containing machine learning best practices.
enlighten-apply - Example code and materials that illustrate applications of SAS machine learning techniques.
enlighten-integration - Example code and materials that illustrate techniques for integrating SAS with other analytics technologies in Java, PMML, Python and R.
enlighten-deep - Example code and materials that illustrate using neural networks with several hidden layers in SAS.
dm-flow - Library of SAS Enterprise Miner process flow diagrams to help you learn by example about specific data mining topics.

Scala

Natural Language Processing

ScalaNLP - ScalaNLP is a suite of machine learning and numerical computing libraries.
Breeze - Breeze is a numerical processing library for Scala.
Chalk - Chalk is a natural language processing library. [Deprecated]
FACTORIE - FACTORIE is a toolkit for deployable probabilistic modeling, implemented as a software library in Scala. It provides its users with a succinct language for creating relational factor graphs, estimating parameters and performing inference.
Montague - Montague is a semantic parsing library for Scala with an easy-to-use DSL.
Spark NLP - Natural language processing library built on top of Apache Spark ML to provide simple, performant, and accurate NLP annotations for machine learning pipelines, that scale easily in a distributed environment.

Data Analysis / Data Visualization

MLlib in Apache Spark - Distributed machine learning library in Spark
Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
Scalding - A Scala API for Cascading.
Summing Bird - Streaming MapReduce with Scalding and Storm.
Algebird - Abstract Algebra for Scala.
xerial - Data management utilities for Scala. [Deprecated]
PredictionIO - PredictionIO, a machine learning server for software developers and data engineers.
BIDMat - CPU and GPU-accelerated matrix library intended to support large-scale exploratory data analysis.
Flink - Open source platform for distributed stream and batch data processing.
Spark Notebook - Interactive and Reactive Data Science using Scala and Spark.

General-Purpose Machine Learning

DeepLearning.scala - Creating statically typed dynamic neural networks from object-oriented & functional programming constructs.
Conjecture - Scalable Machine Learning in Scalding.
brushfire - Distributed decision tree ensemble learning in Scala.
ganitha - Scalding powered machine learning. [Deprecated]
adam - A genomics processing engine and specialized file format built using Apache Avro, Apache Spark and Parquet. Apache 2 licensed.
bioscala - Bioinformatics for the Scala programming language
BIDMach - CPU and GPU-accelerated Machine Learning Library.
Figaro - a Scala library for constructing probabilistic models.
H2O Sparkling Water - H2O and Spark interoperability.
FlinkML in Apache Flink - Distributed machine learning library in Flink.
DynaML - Scala Library/REPL for Machine Learning Research.
Saul - Flexible Declarative Learning-Based Programming.
SwiftLearner - Simply written algorithms to help study ML or write your own implementations.
Smile - Statistical Machine Intelligence and Learning Engine.
doddle-model - An in-memory machine learning library built on top of Breeze. It provides immutable objects and exposes its functionality through a scikit-learn-like API.
TensorFlow Scala - Strongly-typed Scala API for TensorFlow.

Scheme

Neural Networks

layer - Neural network inference from the command line, implemented in CHICKEN Scheme.

Swift

General-Purpose Machine Learning

Bender - Fast Neural Networks framework built on top of Metal. Supports TensorFlow models.
Swift AI - Highly optimized artificial intelligence and machine learning library written in Swift.
BrainCore - The iOS and OS X neural network framework.
swix - A bare bones library that includes a general matrix language and wraps some OpenCV for iOS development. [Deprecated]
AIToolbox - A toolbox framework of AI modules written in Swift: Graphs/Trees, Linear Regression, Support Vector Machines, Neural Networks, PCA, KMeans, Genetic Algorithms, MDP, Mixture of Gaussians.
MLKit - A simple Machine Learning Framework written in Swift. Currently features Simple Linear Regression, Polynomial Regression, and Ridge Regression.
Swift Brain - The first neural network / machine learning library written in Swift. This is a project for AI algorithms in Swift for iOS and OS X development. This project includes algorithms focused on Bayes theorem, neural networks, SVMs, Matrices, etc...
Perfect TensorFlow - Swift Language Bindings of TensorFlow. Using native TensorFlow models on both macOS / Linux.
PredictionBuilder - A library for machine learning that builds predictions using a linear regression.
Awesome CoreML - A curated list of pretrained CoreML models.
Awesome Core ML Models - A curated list of machine learning models in CoreML format.

TensorFlow

General-Purpose Machine Learning

Awesome TensorFlow - A list of all things related to TensorFlow.
Golden TensorFlow - A page of content on TensorFlow, including academic papers and links to related topics.

Tools

Neural Networks

layer - Neural network inference from the command line

Misc

ML Workspace - All-in-one web-based IDE for machine learning and data science. The workspace is deployed as a docker container and is preloaded with a variety of popular data science libraries (e.g., Tensorflow, PyTorch) and dev tools (e.g., Jupyter, VS Code).
Notebooks - A starter kit for Jupyter notebooks and machine learning. Companion docker images consist of all combinations of python versions, machine learning frameworks (Keras, PyTorch and Tensorflow) and CPU/CUDA versions.
DVC - Data Science Version Control is an open-source version control system for machine learning projects with pipelines support. It makes ML projects reproducible and shareable.

原文：https://github.com/josephmisiti/awesome-machine-learning

本文：

讨论：请加入知识星球或者小红圈【首席架构师圈】

47 次浏览

SEO Title

A curated list of awesome Machine Learning frameworks, libraries and software.

【首席架构师推荐】免费数据可视化软件

语言 Chinese, Simplified

免费数据可视化软件

G

J

M

MayaVi

P

R

Renjin

V

原文：https://en.wikipedia.org/wiki/Category:Free_data_visualization_software

本文：https://pub.intelligentx.net/wikipedia-free-data-visualization-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

42 次浏览

SEO Title

wikipedia Free data visualization software

【首席架构师推荐】数值分析软件列表

语言 Chinese, Simplified

这里列出了一些值得注意的最终用户计算机应用程序，用于数值或数据分析:

Numerical-software packages

Analytica is a widely used proprietary tool for building and analyzing numerical models. It is a declarative and visual programming language based on influence diagrams.
FlexPro is a program for data analysis and presentation of measurement data. It provides a rich Excel-like user interface and its built-in vector programming language FPScript has a syntax similar to MATLAB.
FreeMat, an open-source MATLAB-like environment with a GPL license.
GNU Octave is a high-level language, primarily intended for numerical computations. It provides a convenient command-line interface for solving linear and nonlinear problems numerically, and for performing other numerical experiments using a language that is mostly compatible with MATLAB. The 4.0 and newer releases of Octave include a GUI. A number of independently developed Linux programs (Cantor, KAlgebra) also offer GUI front-ends to Octave. An active community provides technical support to users.
Jacket, A proprietary GPU Toolbox for MATLAB, enabling some MATLAB computations to be offloaded to the GPU for acceleration and data visualization purposes.
jLab, a research platform for building an open-source MATLAB-like environment in pure Java and Groovy. Currently supports interpreted j-Scripts (MATLAB-like) and compiled GroovySci (extension to Groovy) scripts that provides direct interfacing to Java code and scripting access to many popular Java scientific libraries (e.g. Weka and JSci) and application Wizards.
Julia (programming language) is a high-level dynamic language with a surface similarity to MATLAB.
LabVIEW offers both textual and graphical-programming approaches to numerical analysis. Its text-based programming language MathScript uses .m-file-script syntax providing some compatibility with MATLAB and its clones.
LAPACK provides Fortran 90 routines for solving systems of simultaneous linear equations, least-squares solutions of linear systems of equations, eigenvalue problems, and singular value problems and the associated matrix factorizations (LU, Cholesky, QR, SVD, Schur, and generalized Schur).
MATLAB is a widely used proprietary software for performing numerical calculations. It comes with its own programming language, in which numerical algorithms can be implemented.
GNU MCSim a simulation and numerical integration package, with fast Monte Carlo and Markov chain Monte Carlo capabilities.
ML.NET is a free-software machine-learning library for the C# programming language.^[1]^[2]
NAG Library is an extensive software library of highly optimized numerical-analysis routines for various programming environments.
O-Matrix
pandas is an open-source BSD-licensed library providing data structures and data analysis tools for the Python programming language.
Perl Data Language provides large multidimensional arrays for the Perl programming language, and utilities for image processing and graphical plotting.
Plotly – Plotting library, Python command line, and graphical interface for analyzing data and creating browser-based graphs. Available for R, Python, MATLAB, Julia, and Perl.
Rlab is another free-software computer program which bears a strong resemblance to MATLAB. Rlab development ceased for several years but it was revived as RlabPlus.
ScaLAPACK is a library of high-performance linear algebra routines for parallel distributed-memory machines that features functionality similar to LAPACK (solvers for dense and banded linear systems, least-squares problems, eigenvalue problems, and singular-value problem).
Scilab is advanced numerical analysis package similar to MATLAB or Octave. Comes with a complete GUI and Xcos which is alternative to Simulink. (free software, GPL-compatible CeCILL license)
Sysquake is a computing environment with interactive graphics for mathematics, physics and engineering. Like other applications from Calerga, it is based on a MATLAB-compatible language.
TK Solver is a mathematical modeling and problem-solving software system based on a declarative, rule-based language, commercialized by Universal Technical Systems, Inc.
Torch is a deep-learning library with support for manipulation, statistical analysis and presentation of Tensors.
XLfit, A plugin to Excel which provides curve-fitting and statistical analysis.

General-purpose computer algebra systems

Main article: List of computer algebra systems

Macsyma, a general-purpose computer algebra system, which has a free GPL-licensed version called Maxima.
Maple, a general-purpose commercial mathematics software package.
Mathcad offers a WYSIWYG interface and the ability to generate publication-quality mathematical equations.
Mathematica offers numerical evaluation, optimization and visualization of a very wide range of numerical functions. It also includes a programming language and computer algebra capabilities.
PARI/GP is a widely used computer algebra system designed for fast computations in number theory (factorizations, algebraic number theory, elliptic curves...), but also contains a large number of other useful functions to compute with mathematical entities such as matrices, polynomials, power series, algebraic numbers etc., and a lot of transcendental functions. PARI is also available as a C library to allow for faster computations.
SageMath is an open-source math software, with a unified Python interface which is available as a text interface or a graphical web-based one. Includes interfaces for open-source and proprietary general purpose CAS, and other numerical analysis programs, like PARI/GP, GAP, gnuplot, Magma, and Maple.
Speakeasy is an interactive numerical environment also featuring an interpreted programming language. Born in the mid '60s for matrix manipulation and still in continuous evolution, it pioneered the most common paradigms of this kind of tools, featuring dynamic typing of the structured data objects, dynamic allocation and garbage collection, operators overloading, dynamic linking of compiled or interpreted additional modules contributed by the community of the users and so on.
Trilinos is a collection of open-source object-oriented libraries for use in scientific and engineering applications. Trilinos is based on scalable, parallel linear-algebra algorithms.

Interface-oriented

Baudline is a time-frequency browser for numerical signals analysis and scientific visualization.
COMSOL Multiphysics is a finite-element analysis, solver and simulation software / FEA Software package for various physics and engineering applications, especially coupled phenomena, or multiphysics.
Dataplot is provided by NIST.
DADiSP is a commercial program focused on DSP that combines the numerical capability of MATLAB with a spreadsheet-like interface.
EJS is an open-source software tool, written in Java, for generating simulations.
Euler Mathematical Toolbox is a powerful numerical laboratory with a programming language that can handle real, complex and interval numbers, vectors and matrices. It can produce 2D/3D plots.
FEATool Multiphysics is a Matlab GUI toolbox for finite element FEM and PDE multiphysics simulations.
FEniCS Project is a collection of project for automated solutions to PDEs.
Hermes is a C++ library of advanced adaptive finite element algorithms to solve PDEs and multiphysics coupled problems.
Fityk is a curve fitting and data-analysis program. Primarily used for peak fitting and analyzing peak data.
FlexPro is a commercial program for interactive and automated analysis and presentation of mainly measurement data. It supports many binary instrument data formats and has its own vectorized programming language.
IGOR Pro, a software package with emphasis on time series, image analysis, and curve fitting. It comes with its own programming language and can be used interactively.
LabPlot is a data analysis and visualization application built on the KDE Platform.
MFEM is a free, lightweight, scalable C++ library for finite element methods .
Origin, a software package that is widely used for making scientific graphs. It comes with its own C/C++ compiler that conforms quite closely to ANSI standard.
PAW is a free data analysis package developed at CERN.
SPSS, an application for statistical analysis.
QtiPlot is a data analysis and scientific visualisation program, similar to Origin.
ROOT is a free object-oriented multi-purpose data-analysis package, developed at CERN.
Salome is a free software that provides a generic platform for pre- and post-processing for numerical simulation.
Shogun, an open-source large-scale machine-learning toolbox that provides several SVM implementations (like libSVM, SVMlight) under a common framework and interfaces to Octave, MATLAB, Python, R
Waffles is a free-software collection of command-line tools designed for scripting machine-learning operations in automated experiments and processes.
Weka is a suite of machine learning software written at the University of Waikato.

Language-oriented

acslX is a software application for modeling and evaluating the performance of continuous systems described by time-dependent, nonlinear differential equations.
ADMB is a software suite for non-linear statistical modeling based on C++ which uses automatic differentiation.
AMPL is a mathematical modeling language for describing and solving high complexity problems for large-scale optimization.
Ch, a commercial C/C++-based interpreted language with computational array for scientific numerical computation and visualization.^[3]
APMonitor: APMonitor is a mathematical modeling language for describing and solving representations of physical systems in the form of differential and algebraic equations.
Armadillo is C++ template library for linear algebra; includes various decompositions, factorisations, and statistics functions; its syntax (API) is similar to MATLAB.
Clojure with numeric libraries Neanderthal, ClojureCUDA, and ClojureCL to call optimized matrix and linear algebra functions on CPU and GPU.
Julia is designed for cloud parallel scientific computing in mind on LLVM-based JIT as a backend. Lightweight “green” threading (coroutines). Direct calls of C functions from code (no wrappers or special APIs needed), support for Unicode. Powerful shell-like capabilities for managing other processes. Lisp-like macros and other metaprogramming facilities.
ELKI a software framework for development of data mining algorithms in Java.
GAUSS, a matrix programming language for mathematics and statistics.
GNU Data Language, a free compiler designed as a drop-in replacement for IDL.
IDL, a commercial interpreted language based on FORTRAN with some vectorization. Widely used in the solar physics, fusion, atmospheric sciences and medical communities. The GNU Data Language is a free alternative.
ILNumerics.Net, a C# math library that brings numeric computing functions for science, engineering and financial analysis to the .NET Framework.
KPP generates Fortran 90, FORTRAN 77, C, or Matlab code for the integration of ordinary differential equations (ODEs) resulting from chemical reaction mechanisms.
Madagascar, an open-source software package for multidimensional data analysis and reproducible computational experiments.
mlpack is an open-source library for machine learning, providing a simple and consistent API, while exploiting C++ language features to provide maximum performance and flexibility
NCAR Command Language is an interpreted language designed specifically for scientific data analysis and visualization.
O-Matrix - a matrix programming language for mathematics, engineering, science, and financial analysis.
OptimJ is a mathematical Java-based modeling language for describing and solving high-complexity problems for large-scale optimization.
Perl Data Language, also known as PDL, an array extension to Perl ver.5, used for data manipulation, statistics, numerical simulation and visualization.
Python with well-known scientific computing packages: NumPy, SymPy and SciPy.
R is a widely used system with a focus on data manipulation and statistics which implements the S language. Many add-on packages are available (free software, GNU GPL license).
SAS, a system of software products for statistics. It includes SAS/IML^[4], a matrix programming language.
VisSim is a visual block-diagram language for simulation of nonlinear dynamic systems and model-based embedded development. Its fast ODE engine supports real-time simulation of complex large-scale models. The highly efficient fixed-point code generator allows targeting of low-cost fixed-point embedded processors.
Wolfram Language which is used within many Wolfram technologies such as Mathematica and the Wolfram Cloud
World Programming System (WPS), supports mixing Python, R and SAS languages in a single-user program for statistical analysis and data manipulation
Yorick is an interpreted programming language designed for numerics, graph plotting and simulation.

Historically significant

Expensive Desk Calculator written for the TX-0 and PDP-1 in the late 1950s or early 1960s.
S is an (array-based) programming language with strong numerical support. R is an implementation of the S language.

【首席架构师推荐】数值计算库一览表

语言 Chinese, Simplified

这是一个著名的数值库列表，这些库用于软件开发中执行数值计算。它不是一个完整的列表，而是一个包含Wikipedia上文章的数字库列表，很少有例外。

典型库的选择取决于一系列不同的需求，例如:期望的特性(例如:大维线性代数、并行计算、偏微分方程)、商业/开源性质、API的可读性、可移植性或平台/编译器依赖性(例如:Linux、Windows、Visual c++、GCC)、速度性能、易用性、开发人员的持续支持、标准遵从性、针对特定应用程序场景的代码的专门优化，甚至要安装的代码库的大小。

由于我们发现很少有全面的调查可用，所以在许多可能的库中几乎总是(至少最初是)有一个艰难的选择。通常情况下，它往往是由用户根据自己的品味和舒适度来决定的，只是因为缺乏适当的信息。

Multi-language

ALGLIB is an open source numerical analysis library which may be used from C++, C#, FreePascal, Delphi, VBA.
ArrayFire is a high performance open source software library for parallel computing with an easy-to-use API.
IMSL Numerical Libraries are libraries of numerical analysis functionality implemented in standard programming languages like C, Java, C# .NET, Fortran, and Python.
The NAG Library is a collection of mathematical and statistical routines for multiple programming languages (C, C++, Fortran, Visual Basic, Java, Python and C#) and packages (MATLAB, Excel, R, LabVIEW).
GNU Octave is an open source high level programming language and library, including a command line interface and GUI, analogous to commercial alternatives such as Maple, MATLAB, Mathematica, etc. APIs, functions and libraries can be called from many platforms, including high level engineering programs, where functions are, in many cases, seamlessly interpreted and integrated in similar fashion to MATLAB. It also can be used with batch orientation.
librsb is an open source library for high performance sparse matrix computations providing multi-threaded primitives to build iterative solvers (implements also the Sparse BLAS standard). It can be used from C, C++, Fortran, and a dedicated GNU Octave package.

C

BLOPEX (Block Locally Optimal Preconditioned Eigenvalue Xolvers) is an open-source library for the scalable (parallel) solution of eigenvalue problems.
FFTW (Fastest Fourier Transform in the West) is a software library for computing Fourier and related transforms.
GNU Scientific Library, a popular, free numerical analysis library implemented in C.
GNU Multi-Precision Library is a library for doing arbitrary-precision arithmetic.
hypre (High Performance Preconditioners) is an open-source library of routines for scalable (parallel) solution of linear systems and preconditioning.
LabWindows/CVI is an ANSI C IDE that includes built-in libraries for analysis of raw measurement data, signal generation, windowing, filter functions, signal processing, linear algebra, array and complex operations, curve fitting and statistics.
Lis is a scalable parallel library for solving systems of linear equations and eigenvalue problems using iterative methods.
Intel MKL, Intel Math Kernel Library (in C), a library of optimized math routines for science, engineering, and financial applications, written in C/C++ and Fortran. Core math functions include BLAS, LAPACK, ScaLAPACK, sparse solvers, fast Fourier transforms, and vector math.
OpenBLAS is an open source implementation of the BLAS API with many hand-crafted optimizations for specific processor types. It performs similar to Intel MKL on Intel processors and higher on various others.
Portable, Extensible Toolkit for Scientific Computation (PETSc), is a suite of data structures and routines for the scalable (parallel) solution of scientific applications modeled by partial differential equations.
SLEPc Scalable Library for Eigenvalue Problem Computations is a PETSc-based open-source library for the scalable (parallel) solution of eigenvalue problems.

C++

Adept is a combined automatic differentiation and array library.
Advanced Simulation Library is free and open source hardware accelerated multiphysics simulation software with an OpenCL-based internal computational engine.
ALGLIB is an open source / commercial numerical analysis library with C++ version
Armadillo is a C++ linear algebra library (matrix and vector maths), aiming towards a good balance between speed and ease of use. It employs template classes, and has optional links to BLAS and LAPACK. The syntax (API) is similar to MATLAB.
Blaze is an open-source, high-performance C++ math library for dense and sparse arithmetic.
Blitz++ is a high-performance vector mathematics library written in C++.
Boost.uBLAS C++ libraries for numerical computation
deal.II is a library supporting all the finite element solution of partial differential equations.
Dlib is a modern C++ library with easy to use linear algebra and optimization tools which benefit from optimized BLAS and LAPACK libraries.
Eigen is a vector mathematics library with performance comparable with Intel's Math Kernel Library
Hermes Project: C++/Python library for rapid prototyping of space- and space-time adaptive hp-FEM solvers.
IML++ is a C++ library for solving linear systems of equations, capable of dealing with dense, sparse, and distributed matrices.
IT++ is a C++ library for linear algebra (matrices and vectors), signal processing and communications. Functionality similar to MATLAB and Octave.
LAPACK++, a C++ wrapper library for LAPACK and BLAS
Intel MKL, Intel Math Kernel Library (in C and C++), a library of optimized math routines for science, engineering, and financial applications, written in C/C++ and Fortran. Core math functions include BLAS, LAPACK, ScaLAPACK, sparse solvers, fast Fourier transforms, and vector math.
mlpack is an open-source library for machine learning, exploiting C++ language features to provide maximum performance and flexibility while providing a simple and consistent API
MTL4 is a generic C++ template library providing sparse and dense BLAS functionality. MTL4 establishes an intuitive interface (similar to MATLAB) and broad applicability thanks to Generic programming.
The NAG Library has C++ API
NTL is a C++ library for number theory.
Trilinos is an effort to develop algorithms and enabling technologies for the solution of large-scale, complex multi-physics engineering and scientific problems. It is a collection of packages.

Delphi

Analytics & Physics: commercial Delphi libraries for symbolic and numerical calculations (including symbolic derivatives) and working with physical values and units of measurement.
ALGLIB - an open source numerical analysis library.

.NET Framework languages C#, F#, VB.NET and PowerShell[edit]

Accord.NET is a collection of libraries for scientific computing, including numerical linear algebra, optimization, statistics, artificial neural networks, machine learning, signal processing and computer vision. LGPLv3, partly GPLv3.
AForge.NET is a computer vision and artificial intelligence library. It implements a number of genetic, fuzzy logic and machine learning algorithms with several architectures of artificial neural networks with corresponding training algorithms. LGPLv3 and partly GPLv3.
ALGLIB is an open source numerical analysis library with C# version. Dual licensed: GPLv2+, commercial license.
ILNumerics.Net Commercial high performance, typesafe numerical array classes and functions for general math, FFT and linear algebra, aims .NET/mono, 32&64 bit, script-like syntax in C#, 2D & 3D plot controls, efficient memory management.
IMSL Numerical Libraries have C# version (commercially licensed). IMSL .Net have announced end of life at the end of 2020.
Math.NET Numerics aims to provide methods and algorithms for numerical computations in science, engineering and every day use. Covered topics include special functions, linear algebra, probability models, random numbers, interpolation, integral transforms and more. Free software under MIT/X11 license.
Measurement Studio is a commercial integrated suite UI controls and class libraries for use in developing test and measurement applications. The analysis class libraries provide various digital signal processing, signal filtering, signal generation, peak detection, and other general mathematical functionality.
ML.NET is a free software machine learning library for the C# programming language.[1][2]
The NAG Library has C# API. Commercially licensed.
NMath by CenterSpace Software: Commercial numerical component libraries for the .NET platform, including signal processing (FFT) classes, a linear algebra (LAPACK & BLAS) framework, and a statistics package.
Numpy.NET offers C# language bindings for NumPy a fundamental library for scientific computing, machine learning and AI.[3] Numpy.NET is free software under MIT license.
NumSharp is an open source N-D Tensor computation library for Data Science, Machine Learning and AI, written in pure C#.[4] NumSharp is free software licensed under the Apache 2.0 license.

Fortran

BLAS (Basic Linear Algebra Subprograms) is a de facto application programming interface standard for publishing libraries to perform basic linear algebra operations such as vector and matrix multiplication.
CERNLIB is a collection of FORTRAN 77 libraries and modules.
EISPACK is a software library for numerical computation of eigenvalues and eigenvectors of matrices, written in FORTRAN. It contains subroutines for calculating the eigenvalues of nine classes of matrices: complex general, complex Hermitian, real general, real symmetric, real symmetric banded, real symmetric tridiagonal, special real tridiagonal, generalized real, and generalized real symmetric matices.
IMSL Numerical Libraries are cross-platform libraries containing a comprehensive set of mathematical and statistical functions that can be embedded in a users application.
Harwell Subroutine Library is a collection of Fortran 77 and 95 codes that address core problems in numerical analysis.
LAPACK, the Linear Algebra PACKage, is a software library for numerical computing originally written in FORTRAN 77 and now written in Fortran 90.
LINPACK is a software library for performing numerical linear algebra on digital computers. It was written in Fortran by Jack Dongarra, Jim Bunch, Cleve Moler, and Pete Stewart, and was intended for use on supercomputers in the 1970s and early 1980s. It has been largely superseded by LAPACK, which will run more efficiently on modern architectures.
Lis is a scalable parallel library for solving systems of linear equations and eigenvalue problems using iterative methods.
MINPACK is a library of FORTRAN subroutines for the solving of systems of nonlinear equations, or the least squares minimization of the residual of a set of linear or nonlinear equations.
The NAG Fortran Library is a collection of mathematical and statistical routines for Fortran.
NOVAS is a software library for astrometry-related numerical computations. Both Fortran and C versions are available.
Netlib is a repository of scientific computing software which contains a large number of separate programs and libraries including BLAS, EISPACK, LAPACK and others.
PAW is a free data analysis package developed at CERN.
Portable, Extensible Toolkit for Scientific Computation (PETSc), is a suite of data structures and routines for the scalable (parallel) solution of scientific applications modeled by partial differential equations.
QUADPACK is a FORTRAN 77 library for numerical integration of one-dimensional functions
SLATEC is a FORTRAN 77 library of over 1400 general purpose mathematical and statistical routines.
SOFA is a collection of subroutines that implement official IAU algorithms for astronomical computations. Both Fortran and C versions are available.
ARPACK is a collection of Fortran77 subroutines designed to solve large scale eigenvalue problems.

Java

ND4J is an open-source library that supports n-dimensional (ND) arrays, similar to NumPy. It runs on distributed GPUs or CPUs cross-platform, and leverages Spark for parallel computation. It supports the deep learning library Deeplearning4j.
Apache Commons, is an open-source for creating reusable Java components. It has numerical packages for linear algebra and non-linear optimization.
Colt provides a set of Open Source Libraries for High Performance Scientific and Technical Computing.
Efficient Java Matrix Library (EJML) is an open-source linear algebra library for manipulating dense matrices.
JAMA, a numerical linear algebra toolkit for the Java programming language. No active development has taken place since 2005, but it still one of the more popular linear algebra packages in Java.
Jblas: Linear Algebra for Java, a linear algebra library which is an easy to use wrapper around BLAS and LAPACK.
Parallel Colt is an open source library for scientific computing. A parallel extension of Colt.
Matrix Toolkit Java is a linear algebra library based on BLAS and LAPACK.
ojAlgo is an open source Java library for mathematics, linear algebra and optimisation.
exp4j is a small Java library for evaluation of mathematical expressions.

Scala

ND4S is a scientific computing library for Scala that includes support for n-dimensional arrays on the JVM.

Perl

Perl Data Language gives standard Perl the ability to compactly store and speedily manipulate the large N-dimensional data arrays.

Python

NumPy, a BSD-licensed library that adds support for the manipulation of large, multi-dimensional arrays and matrices; it also includes a large collection of high-level mathematical functions. NumPy serves as the backbone for a number of other numerical libraries, notably SciPy. De facto standard for matrix/tensor operations in Python.
SageMath is a large mathematical software application which integrates the work of nearly 100 free software projects and supports linear algebra, combinatorics, numerical mathematics, calculus, and more.
SciPy, a large BSD-licensed library of scientific tools. De facto standard for scientific computations in Python.
ScientificPython, a library with a different set of scientific tools
SymPy , a library based on New BSD license for symbolic computation. Features of Sympy range from basic symbolic arithmetic to calculus, algebra, discrete mathematics and quantum physics.

Others

XNUMBERS — Multi Precision Floating Point Computing and Numerical Methods for Microsoft Excel.
INTLAB — Interval arithmetic library for MATLAB.

【首席架构师推荐】文本挖掘软件列表

语言 Chinese, Simplified

文本挖掘计算机程序可从许多商业和开放源码公司和源代码获得。

Commercial

Amenity Analytics – develops cloud-based text analytics solutions using natural language processing and machine learning to draw insights at scale from any source of unstructured data.
Angoss – Angoss Text Analytics provides entity and theme extraction, topic categorization, sentiment analysis and document summarization capabilities via the embedded
AUTINDEX - is a commercial text mining software package based on sophisticated linguistics by IAI (Institute for Applied Information Sciences), Saarbrücken.
Autonomy – text mining, clustering and categorization software
Averbis – provides text analytics, clustering and categorization software, as well as terminology management and enterprise search
Basis Technology – provides a suite of text analysis modules to identify language, enable search in more than 20 languages, extract entities, and efficiently search for and translate entities.
Clarabridge – text analytics (text mining) software, including natural language (NLP), machine learning, clustering and categorization. Provides SaaS, hosted and on-premises text and sentiment analytics that enables companies to collect, listen to, analyze, and act on the Voice of the Customer (VOC) from both external (Twitter, Facebook, Yelp!, product forums, etc.) and internal sources (call center notes, CRM, Enterprise Data Warehouse, BI, surveys, emails, etc.).
DigitalMR - social media listening & text+image analytics tool for market research
Endeca Technologies – provides software to analyze and cluster unstructured text.
FICO Score – leading provider of analytics.
General Sentiment - Social Intelligence platform that uses natural language processing to discover affinities between the fans of brands with the fans of traditional television shows in social media. Stand alone text analytics to capture social knowledge base on billions of topics stored to 2004.
IBM LanguageWare - the IBM suite for text analytics (tools and Runtime).
IBM SPSS - provider of Modeler Premium (previously called IBM SPSS Modeler and IBM SPSS Text Analytics), which contains advanced NLP-based text analysis capabilities (multi-lingual sentiment, event and fact extraction), that can be used in conjunction with Predictive Modeling. Text Analytics for Surveys provides the ability to categorize survey responses using NLP-based capabilities for further analysis or reporting.
Inxight – provider of text analytics, search, and unstructured visualization technologies. (Inxight was bought by Business Objects that was bought by SAP AG in 2008).
Language Computer Corporation – text extraction and analysis tools, available in multiple languages.
Lexalytics - provider of a text analytics engine used in Social Media Monitoring, Voice of Customer, Survey Analysis, and other applications. Salience Engine. The software provides the unique capability of merging the output of unstructured, text-based analysis with structured data to provide additional predictive variables for improved predictive models and association analysis.
LexisNexis – provider of business intelligence solutions based on an extensive news and company information content set. LexisNexis acquired DataOps to pursue search
Linguamatics – provider of natural language processing (NLP) based enterprise text mining and text analytics software, I2E, for high-value knowledge discovery and decision support.
Luminoso – enterprise feedback and text analytics solutions developed over a decade of natural language processing (NLP), machine learning and artificial intelligence research at MIT Media Lab. Enables clients to understand, measure and act on large amounts of consumer feedback, across multiple channels.^[1]^[2]
Mathematica – provides built in tools for text alignment, pattern matching, clustering and semantic analysis. See Wolfram Language, the programming language of Mathematica.
MATLAB offers Text Analytics Toolbox for importing text data, converting it to numeric form for use in machine and deep learning, sentiment analysis and classification tasks.^[3]
MeaningCloud - formerly known as Textalytics: a set of text analytics APIs offered both in SaaS mode and on-premises that are totally customizable to obtain the highest accuracy and very easy to integrate in any system or environment thanks to its SDKs and plug-ins.
Medallia - offers one system of record for survey, social, text, written and online feedback.
Megaputer Intelligence - derives actionable knowledge from large volumes of text and structured data, including natural language processing (NLP), machine learning, sentiment analysis, entity extraction, clustering, and categorization.
NetOwl – suite of multilingual text and entity analytics products, including entity extraction, link and event extraction, sentiment analysis, geotagging, name translation, name matching, and identity resolution, among others.
PoolParty Semantic Suite lets you develop a knowledge graph – thus structure and represent your prioritised knowledge domains. The highly performative PoolParty service extracts entities and terms following a sophisticated text mining algorithm.
RapidMiner with its Text Processing Extension – data and text mining software.
SAS – SAS Text Miner and Teragram; commercial text analytics, natural language processing, and taxonomy software used for Information Management.
Semantria - offers its services via API and Excel plugin. It is a spinoff of text-analysis software Lexalytics, but differs in that it is offered via API and Excel plugin, and in that it incorporates a bigger knowledge base and uses deep learning.
Sketch Engine - a corpus manager and analysis software which providing creating text corpora from uploaded texts or the Web including part-of-speech tagging and lemmatization or detecting a particular website.^[4]
Smartlogic – Semaphore; Content Intelligence platform containing commercial text analytics, natural language processing, rule-based classification, ontology/taxonomy modelling and information visualization software used for Information Management.
StatSoft – provides STATISTICA Text Miner as an optional extension to STATISTICA Data Miner, for Predictive Analytics Solutions.
Sysomos - provider social media analytics software platform, including text analytics and sentiment analysis on online consumer conversations.
WordStat - Content analysis and text mining add-on module of QDA Miner for analyzing large amounts of text data.

Open source

Carrot2 – text and search results clustering framework.
Coding Analysis Toolkit – CAT is a free, web-based, and open source text analysis service. Load, code, and annotate text data in teams. Measure inter-rater reliability and adjudicate differences between coders. Report on the accuracy of codes and coders over time. Train better coders through systematic iterations.
GATE – general Architecture for Text Engineering, an open-source toolbox for natural language processing and language engineering.
Gensim - large-scale topic modelling and extraction of semantic information from unstructured text (Python).
Natural Language Toolkit (NLTK) – a suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the Python programming language.
OpenNLP - natural language processing.
Orange with its text mining add-on.
Stanbol - an open source text mining engine targeted at semantic content management.
The programming language R provides a framework for text mining applications in the package tm.^[5] The Natural Language Processing task view contains tm and other text mining library packages.^[6]
The KNIME Text Processing extension.
The PLOS Text Mining Collection.^[7]
Voyant Tools - a web-based text analysis environment, created as a scholarly project.
spaCy - open-source Natural Language Processing library for Python

References

^ Alba, Davet (12 February 2015). "The Startup That Helps You Analyze Twitter Chatter in Real Time". Wired. Retrieved 4 March 2015.
^ Lohr, Steve (27 June 2014). "The U.S.-Germany Match Through a Social Media Lens". New York Times. Retrieved 4 March 2015.
^ "Text Analytics Toolbox". www.mathworks.com. Retrieved 2019-07-10.
^ "Text analysis with Sketch Engine". Sketch Engine. LEXICAL COMPUTING CZ s.r.o. Retrieved 17 January 2018.
^ Introduction to the tm Package: Text Mining in R
^ CRAN Task View: Natural Language Processing
^ "Table of Contents: Text Mining". PLOS.

External links

原文：https://en.wikipedia.org/wiki/List_of_text_mining_software

本文：https://pub.intelligentx.net/wikipedia-list-text-mining-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

121 次浏览

SEO Title

wikipedia List of text mining software

【首席架构师推荐】深度学习软件比较

语言 Chinese, Simplified

下表比较了用于深度学习的著名软件框架、库和计算机程序。

Deep-learning software by name

Software	Initial Release	Software license^[a]	Open source	Platform	Written in	Interface	OpenMP support	OpenCL support	CUDA support	Automatic differentiation^[1]	Has pretrained models	Recurrent nets	Convolutional nets	RBM/DBNs	Parallel execution (multi node)	Actively Developed
BigDL	2016	Apache 2.0	Yes	Apache Spark	Scala	Scala, Python			No		Yes	Yes	Yes
Caffe	2013	BSD	Yes	Linux, macOS, Windows^[2]	C++	Python, MATLAB, C++	Yes	Under development^[3]	Yes	Yes	Yes^[4]	Yes	Yes	No	?
Chainer	2015	BSD	Yes	Linux, macOS	Python	Python	No	No	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes
Deeplearning4j	2014	Apache 2.0	Yes	Linux, macOS, Windows, Android (Cross- platform)	C++, Java	Java, Scala, Clojure, Python (Keras), Kotlin	Yes	No^[5]	Yes^[6]^[7]	Computational Graph	Yes^[8]	Yes	Yes	Yes	Yes^[9]
Dlib	2002	Boost Software License	Yes	Cross- Platform	C++	C++	Yes	No	Yes	Yes	Yes	No	Yes	Yes	Yes
Intel Data Analytics Acceleration Library	2015	Apache License 2.0	Yes	Linux, macOS, Windows on Intel CPU^[10]	C++, Python, Java	C++, Python, Java^[10]	Yes	No	No	Yes	No		Yes		Yes
Intel Math Kernel Library		Proprietary	No	Linux, macOS, Windows on Intel CPU^[11]		C^[12]	Yes^[13]	No	No	Yes	No	Yes^[14]	Yes^[14]		No
Keras	2015	MIT license	Yes	Linux, macOS, Windows	Python	Python, R	Only if using Theano as backend	Can use Theano, Tensorflow or PlaidML as backends	Yes	Yes	Yes^[15]	Yes	Yes	No^[16]	Yes^[17]	Yes
MATLAB + Deep Learning Toolbox		Proprietary	No	Linux, macOS, Windows	C, C++, Java, MATLAB	MATLAB	No	No	Train with Parallel Computing Toolbox and generate CUDA code with GPU Coder^[18]	No	Yes^[19]^[20]	Yes^[19]	Yes^[19]	No	With Parallel Computing Toolbox^[21]	Yes
Microsoft Cognitive Toolkit (CNTK)	2016	MIT license^[22]	Yes	Windows, Linux^[23] (macOS via Docker on roadmap)	C++	Python (Keras), C++, Command line,^[24] BrainScript^[25] (.NET on roadmap^[26])	Yes^[27]	No	Yes	Yes	Yes^[28]	Yes^[29]	Yes^[29]	No^[30]	Yes^[31]	No^[32]
Apache MXNet	2015	Apache 2.0	Yes	Linux, macOS, Windows,^[33]^[34] AWS, Android,^[35] iOS, JavaScript^[36]	Small C++ core library	C++, Python, Julia, Matlab, JavaScript, Go, R, Scala, Perl	Yes	On roadmap^[37]	Yes	Yes^[38]	Yes^[39]	Yes	Yes	Yes	Yes^[40]	Yes
Neural Designer		Proprietary	No	Linux, macOS, Windows	C++	Graphical user interface	Yes	No	No	?	?	No	No	No	?
OpenNN	2003	GNU LGPL	Yes	Cross -platform	C++	C++	Yes	No	Yes	?	?	No	No	No	?
PlaidML	2017	AGPL	Yes	Linux, macOS, Windows	Python, C++, OpenCL	Python, C++	?	Some OpenCL ICDs are not recognized	No	Yes	Yes	Yes	Yes		Yes	Yes
PyTorch	2016	BSD	Yes	Linux, macOS, Windows	Python, C, C++, CUDA	Python, C++	Yes	Via separately maintained package ^[41] ^[^42]^[42]	Yes	Yes	Yes	Yes	Yes		Yes	Yes
Apache SINGA	2015	Apache 2.0	Yes	Linux, macOS, Windows	C++	Python, C++, Java	No	Supported in V1.0	Yes	?	Yes	Yes	Yes	Yes	Yes
TensorFlow	2015	Apache 2.0	Yes	Linux, macOS, Windows,^[43] Android	C++, Python, CUDA	Python (Keras), C/C++, Java, Go, JavaScript, R,^[44] Julia, Swift	No	On roadmap ^[45] but already with SYCL^[46] support	Yes	Yes^[47]	Yes^[48]	Yes	Yes	Yes	Yes	Yes
Theano	2007	BSD	Yes	Cross -platform	Python	Python (Keras)	Yes	Under develo pment^[49]	Yes	Yes^[50]^[51]	Through Lasagne's model zoo^[52]	Yes	Yes	Yes	Yes^[53]	No
Torch	2002	BSD	Yes	Linux, macOS, Windows,^[54] Android,^[55] iOS	C, Lua	Lua, LuaJIT, ^[56] C, utility library for C++/ OpenCL^[57]	Yes	Third party implemen tations^[58]^[59]	Yes^[60]^[61]	Through Twitter's Autograd^[62]	Yes^[63]	Yes	Yes	Yes	Yes^[54]	No
Wolfram Mathematica	1988	Proprietary	No	Windows, macOS, Linux, Cloud computing	C++, Wolfram Language, CUDA	Wolfram Language	Yes	No	Yes	Yes	Yes^[64]	Yes	Yes	Yes	Yes^[65]	Yes

^ Licenses here are a summary, and are not taken to be complete statements of the licenses. Some libraries may use other libraries internally under different licenses

Related software

Neural Engineering Object (NENGO) – A graphical and scripting software for simulating large-scale neural systems
Numenta Platform for Intelligent Computing – Numenta's open source implementation of their hierarchical temporal memory model

【首席架构师推荐】精选优化软件清单

语言 Chinese, Simplified

给定一个输入和输出值之间的转换,描述一个数学函数f,优化处理生成和选择一个最佳解决方案从一些组可用的替代方案,通过系统地选择输入值在一个允许集,计算的输出功能,录音过程中发现的最好的输出值。许多实际问题都可以用这种方法建模。例如，输入可以是电机的设计参数，输出可以是功耗，或者输入可以是业务选择，输出可以是获得的利润。

优化问题，在本例中是最小化问题，可以用以下方式表示

给定:一个函数f:一个{\displaystyle \to}\to R，从某个集合a到实数

搜索:A中的一个元素x0，使得f(x0)≤f(x)对于A中的所有x。

在连续优化中，A是欧氏空间Rn的某个子集，通常由一组约束、等式或不等式来指定，这些约束、等式或不等式是A的成员必须满足的。在组合优化中，A是离散空间的某个子集，如二进制字符串、排列或整数集。

优化软件的使用要求函数f用合适的编程语言定义，并在编译或运行时连接到优化软件。优化软件将在A中提供输入值，实现f的软件模块将提供计算值f(x)，在某些情况下，还将提供关于函数的附加信息，如导数。

这样就得到了一个清晰的关注点分离:不同的优化软件模块可以很容易地在同一个函数f上进行测试，或者给定的优化软件可以用于不同的函数f。

下表提供了根据许可证和业务模型类型组织的值得注意的优化软件列表。

Free and open-source software

Applications

Name	License	Description
ADMB	BSD	a nonlinear optimization framework, using automatic differentiation.
ASCEND	GPL	a mathematical modelling chemical process modelling system.
CUTEr	GPL	a testing environment for optimization and linear algebra solvers.
GNU_Octave	GPL	a software package featuring a high-level programming language, primarily intended for numerical computations; well recognized free alternative to MATLAB.
Scilab	CeCILL	a cross-platform numerical computational package and a high-level, numerically oriented programming language with free numerical optimization framework.

Software libraries

Name	License	Description
ALGLIB	GPL	dual licensed (GPL/commercial) nonlinear optimization library (unconstrained, box, linearly, nonlinearly-constrained, nonlinear and QP problems), optionally using automatic differentiation. Cross-language: C++, C#.
COIN-OR SYMPHONY	EPL 1.0	integer programming
Dlib	Boost Software License	Unconstrained/box-constrained nonlinear/QP optimization library written in C++.
GEKKO	MIT License	machine learning and optimization of mixed-integer and differential algebraic equations in Python.
GLPK	GPL	GNU Linear Programming Kit, C API.
IPOPT	CPL	a large scale nonlinear optimizer for continuous systems (requires gradient), C++ (formerly Fortran and C).
J. D. Powell's optimization suite	LGPL	a set of Fortran 95 algorithms for (derivative-free, DFO) optimization subject to box and linear constraints: BOBYQA – DFO, box; COBYLA – DFO, nonlinearly constrained; LINCOA – DFO, linearly constrained; NEWUOA and UOBYQA – DFO, unconstrained; TOLMIN – linearly constrained.
MIDACO	Dual (Commercial, BY-NC-ND)	a lightweight software tool for single- and multi-objective optimization based on evolutionary computing. Written in C/C++ and Fortran with gateways to Excel, VBA, Java, Python, Matlab, Octave, R, C# and Julia.
MINUIT (now MINUIT2)	LGPL	an unconstrained optimizer internally developed at CERN.
OpenMDAO	Apache License	a Multidisciplinary Design, Analysis, and Optimization (MDAO) framework, written in Python. The development is led out of the NASA Glenn Research Center, with support from the NASA Langley Research Center.
OptaPlanner	Apache License	a lightweight, embeddable planning engine written in Java. It solves constraint satisfaction problems with construction heuristics and metaheuristic algorithms.
SciPy	BSD	a general numeric package for Python, with some support for optimization.

Proprietary software

AIMMS – optimization modeling system, including GUI building facilities.
ALGLIB – dual licensed (GPL/commercial) constrained quadratic and nonlinear optimization library with C++ and C# interfaces.
Altair HyperStudy – design of experiments and multi-disciplinary design optimization.
AMPL – modelling language for large-scale linear, mixed integer and nonlinear optimization.
ANTIGONE – a deterministic global optimization MINLP solver.
APMonitor – modeling language and optimization suite for large-scale, nonlinear, mixed integer, differential and algebraic equations with interfaces to MATLAB, Python, and Julia.
Artelys Knitro – large scale nonlinear optimization for continuous and mixed-integer programming.
ASTOS – AeroSpace Trajectory Optimization Software for launcher, re-entry and generic aerospace problems.
BARON – optimization of algebraic nonlinear and mixed-integer nonlinear problems.
COMSOL Multiphysics – a cross-platform finite element analysis, solver and multiphysics simulation software.
CPLEX – integer, linear and quadratic programming.
FEATool Multiphysics – FEA GUI Toolbox for MATLAB
FICO Xpress – integer, linear and quadratic and nonlinear programming.
FortMP – integer, linear and quadratic programming.
FortSP – stochastic programming.
GAMS – General Algebraic Modeling System.
Gurobi – integer, linear and quadratic programming.
HEEDS MDO – multidisciplinary design optimization using SHERPA, a hybrid, adaptive optimization algorithm.
IMSL Numerical Libraries – linear, quadratic, nonlinear, and sparse QP and LP optimization algorithms implemented in standard programming languages C, Java, C# .NET, Fortran, and Python.
IOSO – (Indirect Optimization on the basis of Self-Organization) a multiobjective, multidimensional nonlinear optimization technology.
Kimeme – an open platform for multi-objective optimization and multidisciplinary design optimization.
LINDO - (Linear, Interactive, and Discrete Optimizer) a software package for linear programming, integer programming, nonlinear programming, stochastic programming, and global optimization. The "What's Best!" Excel add-in performs linear, integer, and nonlinear optimization using LINDO.
LIONsolver – an integrated software for data mining, analytics, modeling Learning and Intelligent OptimizatioN and reactive business intelligence approach.
modeFRONTIER – an integration platform for multi-objective and multi-disciplinary optimization, which provides a seamless coupling with third party engineering tools, enables the automation of the design simulation process, and facilitates analytic decision making.
Maple – linear, quadratic, and nonlinear, continuous and integer optimization. Constrained and unconstrained. Global optimization with add-on toolbox.
MATLAB – linear, integer, quadratic, and nonlinear problems with Optimization Toolbox; multiple maxima, multiple minima, and non-smooth optimization problems; estimation and optimization of model parameters.
MIDACO a lightweight software tool for single- and multi-objective optimization based on evolutionary computing. Written in C/C++ and Fortran with gateways to Excel, VBA, Java, Python, Matlab, Octave, R, C# and Julia.
Mathematica – large-scale multivariate constrained and unconstrained, linear and nonlinear, continuous and integer optimization.
ModelCenter – a graphical environment for integration, automation, and design optimization.
MOSEK – linear, quadratic, conic and convex nonlinear, continuous and integer optimization.
NAG – linear, quadratic, nonlinear, sums of squares of linear or nonlinear functions; linear, sparse linear, nonlinear, bounded or no constraints; local and global optimization; continuous or integer problems.
NMath – linear, quadratic and nonlinear programming.
OptimJ – Java-based modeling language. Premium Edition includes support for Gurobi, Mosek and CPLEX solvers.
Optimus platform – a process integration and design optimization platform developed by Noesis Solutions.
optiSLang – software solutions for CAE-based sensitivity analysis, optimization and robustness evaluation.
OptiY - a design environment providing modern optimization strategies and state of the art probabilistic algorithms for uncertainty, reliability, robustness, sensitivity analysis, data-mining and meta-modeling.
OptiStruct – award-winning CAE technology for conceptual design synthesis and structural optimization.
PottersWheel – parameter estimation in ordinary differential equations (MATLAB toolbox, free for academic use).
pSeven — software platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining, developed by DATADVANCE.
SAS – a software suite developed by SAS Institute for advanced analytics (statistics, forcasting, machine learning, optimization, etc.), business intelligence, customer intelligence, data management, risk management, and many more.
SmartDO – multidisciplinary global design optimization, specialized in computer-aided engineering (CAE). using the direct global search approaches.
SNOPT – large-scale optimization problems.
The Unscrambler X – product formulation and process optimization software.
TOMLAB – supports global optimization, integer programming, all types of least squares, linear, quadratic and unconstrained programming for MATLAB. TOMLAB supports solvers like Gurobi, CPLEX, SNOPT, KNITRO and MIDACO.
VisSim – a visual block diagram language for simulation and optimization of dynamical systems.
WORHP – a large-scale sparse solver for continuous nonlinear optimization.

Freeware/free for academic use

AIMMS
AMPL
APMonitor – free for academic and commercial use alike, with Julia, Python and MATLAB integrations.
ASTOS
CPLEX
Couenne – An open source solver for the deterministic global optimization of MINLPs licensed under the Eclipse Public License.
FICO Xpress
Galahad library
GEKKO Python
Gurobi
LIONsolver
MIDACO – a software package for numerical optimization based on evolutionary computing.
MINTO – integer programming solver using branch and bound algorithm; freeware for personal use.
MOSEK – a large scale optimization software. Solves linear, quadratic, conic and convex nonlinear, continuous and integer optimization.
OptimJ – Java-based modeling language; the free edition includes support for lp_solve, GLPK and LP or MPS file formats.
PottersWheel – parameter estimation in ordinary differential equations (free MATLAB toolbox for academic use).
SCIP – free to members of non-commercial and academic institutions, for research purposes.
WORHP

【首席架构师推荐】精选免费数据分析软件

语言 Chinese, Simplified

免费数据分析软件

D

Deeplearning4j

E

Encog
ELKI

F

Fluentd

J

Julia (programming language)

M

Massive Online Analysis

N

T

Tanagra (machine learning)

V

D3.js

W

X

XGBoost

Y

Yooreeka

原文：https://en.wikipedia.org/wiki/Category:Free_data_analysis_software

本文：https://pub.intelligentx.net/wikipedia-free-data-analysis-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

99 次浏览

SEO Title

wikipedia Free data analysis software

【首席架构师推荐】精选数据分析软件列表

语言 Chinese, Simplified

精选数据分析软件列表

A

B

C

D

E

F

Fityk
Fsc2

G

H

HippoDraw

I

J

K

Kirix Strata

L

M

N

O

P

R

RCFile
ROOT

S

T

U

UNISoN (Social Network Analysis Tool)

W

WarpPLS

X

XLfit

原文：https://en.wikipedia.org/wiki/Category:Data_analysis_software

本文：https://pub.intelligentx.net/wikipedia-data-analysis-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

82 次浏览

SEO Title

wikipedia Data analysis software

【首席架构师推荐】精选数据挖掘和机器学习软件列表

语言 Chinese, Simplified

精选数据挖掘和机器学习软件列表

A

B

BigDL

C

D

E

Encog
ELKI

F

G

I

J

K

L

M

N

O

P

R

S

T

U

UIMA

V

W

X

XGBoost

Y

Yooreeka

Z

Zeroth (software)

原文：https://en.wikipedia.org/wiki/Category:Data_mining_and_machine_learning_software

本文：https://pub.intelligentx.net/wikipedia-data-mining-and-machine-learning-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

48 次浏览

SEO Title

wikipedia Data mining and machine learning software

【首席架构师推荐】统计软件一览表

语言 Chinese, Simplified

统计软件是专门用于统计和计量经济学分析的计算机程序。

Open-source

ADaMSoft – a generalized statistical software with data mining algorithms and methods for data management
ADMB – a software suite for non-linear statistical modeling based on C++ which uses automatic differentiation
Bayesian Filtering Library
Chronux – for neurobiological time series data
DAP – free replacement for SAS
Environment for DeveLoping KDD-Applications Supported by Index-Structures (ELKI) a software framework for developing data mining algorithms in Java
Fityk – nonlinear regression software (GUI and command line)
GNU Octave – programming language very similar to MATLAB with statistical features
gretl – gnu regression, econometrics and time-series library
intrinsic Noise Analyzer (iNA) – For analyzing intrinsic fluctuations in biochemical systems
JASP – A free software alternative to IBM SPSS Statistics with additional option for Bayesian methods
Just another Gibbs sampler (JAGS) – a program for analyzing Bayesian hierarchical models using Markov chain Monte Carlo developed by Martyn Plummer. It is similar to WinBUGS
JMulTi – For econometric analysis, specialised in univariate and multivariate time series analysis
KNIME - An open source analytics platform built with Java and Eclipse using modular data pipeline workflows
LIBSVM – C++ support vector machine libraries
mlpack – open-source library for machine learning, exploits C++ language features to provide maximum performance and flexibility while providing a simple and consistent application programming interface (API)
Mondrian – data analysis tool using interactive statistical graphics with a link to R
Neurophysiological Biomarker Toolbox – Matlab toolbox for data-mining of neurophysiological biomarkers
OpenBUGS
OpenEpi – A web-based, open-source, operating-independent series of programs for use in epidemiology and statistics based on JavaScript and HTML
OpenNN – A software library written in the programming language C++ which implements neural networks, a main area of deep learning research
OpenMx – A package for structural equation modeling running in R (programming language)
Orange, a data mining, machine learning, and bioinformatics software
Pandas – High-performance computing (HPC) data structures and data analysis tools for Python in Python and Cython (statsmodels, scikit-learn)
Perl Data Language – Scientific computing with Perl
Ploticus – software for generating a variety of graphs from raw data
PSPP – A free software alternative to IBM SPSS Statistics
R – free implementation of the S (programming language)
- Programming with Big Data in R (pbdR) – a series of R packages enhanced by SPMD parallelism for big data analysis
- R Commander – GUI interface for R
- Rattle GUI – GUI interface for R
- Revolution Analytics – production-grade software for the enterprise big data analytics
- RStudio – GUI interface and development environment for R
ROOT – an open-source C++ system for data storage, processing and analysis, developed by CERN and used to find the Higgs boson
Salstat – menu-driven statistics software
Scilab – uses GPL-compatible CeCILL license
SciPy – Python library for scientific computing that contains the stats sub-package which is partly based on the venerable |STAT (a.k.a. PipeStat, formerly UNIX|STAT) software
- scikit-learn – extends SciPy with a host of machine learning models (classification, clustering, regression, etc.)
- statsmodels – extends SciPy with statistical models and tests (regression, plotting, example datasets, generalized linear model (GLM), time series analysis, autoregressive–moving-average model (ARMA), vector autoregression (VAR), non-parametric statistics, ANOVA, empirical likelihood)
Shogun (toolbox) – open-source, large-scale machine learning toolbox that provides several SVM (Support Vector Machine) implementations (like libSVM, SVMlight) under a common framework and interfaces to Octave, MATLAB, Python, R
Simfit – simulation, curve fitting, statistics, and plotting
SOCR
SOFA Statistics – desktop GUI program focused on ease of use, learn as you go, and beautiful output
Stan (software) – open-source package for obtaining Bayesian inference using the No-U-Turn sampler, a variant of Hamiltonian Monte Carlo. It is somewhat like BUGS, but with a different language for expressing models and a different sampler for sampling from their posteriors
Statistical Lab – R-based and focusing on educational purposes
Torch (machine learning) – a deep learning software library written in Lua (programming language)
Weka (machine learning) – a suite of machine learning software written at the University of Waikato

Public domain

Freeware

BV4.1
GeoDA
MaxStat Lite – general statistical software
MINUIT
WinBUGS – Bayesian analysis using Markov chain Monte Carlo methods
Winpepi – package of statistical programs for epidemiologists

Proprietary

Alteryx - analytics platform with drag and drop statistical models; R and Python integration
Analytica – visual analytics and statistics package
Angoss – products KnowledgeSEEKER and KnowledgeSTUDIO incorporate several data mining algorithms
ASReml – for restricted maximum likelihood analyses
BMDP – general statistics package
DB Lytix – 800+ in-database models
EViews – for econometric analysis
FAME (database) – a system for managing time-series databases
GAUSS – programming language for statistics
Genedata – software solution for integration and interpretation of experimental data in the life science R&D
GenStat – general statistics package
GLIM – early package for fitting generalized linear models
GraphPad InStat – very simple with lots of guidance and explanations
GraphPad Prism – biostatistics and nonlinear regression with clear explanations
IMSL Numerical Libraries – software library with statistical algorithms
JMP – visual analysis and statistics package
Lertap 5- an Excel application used to analyze responses to tests and surveys (free for students)
LIMDEP – comprehensive statistics and econometrics package
LISREL – statistics package used in structural equation modeling
Maple – programming language with statistical features
Mathematica – a software package with statistical particularlyŋ features
MATLAB – programming language with statistical features
MaxStat Pro – general statistical software
MedCalc – for biomedical sciences
Microfit – econometrics package, time series
Minitab – general statistics package
MLwiN – multilevel models (free to UK academics)
NAG Numerical Library – comprehensive math and statistics library
Neural Designer – commercial deep learning package
NCSS – general statistics package
NLOGIT – comprehensive statistics and econometrics package
NMath Stats – statistical package for .NET Framework
nQuery Sample Size Software – Sample Size and Power Analysis Software^[1]
O-Matrix – programming language
OriginPro – statistics and graphing, programming access to NAG library
PASS Sample Size Software (PASS) – power and sample size software from NCSS
Plotly – plotting library and styling interface for analyzing data and creating browser-based graphs. Available for R, Python, MATLAB, Julia, and Perl
Primer-E Primer – environmental and ecological specific
PV-WAVE – programming language comprehensive data analysis and visualization with IMSL statistical package
Qlucore Omics Explorer – interactive and visual data analysis software
Quantum Programming Language – part of the SPSS MR product line, mostly for data validation and tabulation in Marketing and Opinion Research
RapidMiner – machine learning toolbox
Regression Analysis of Time Series (RATS) – comprehensive econometric analysis package
SAS (software) – comprehensive statistical package
SHAZAM (Econometrics and Statistics Software) – comprehensive econometrics and statistics package
Simul – econometric tool for multidimensional (multi-sectoral, multi-regional) modeling
SigmaStat – package for group analysis
SmartPLS – statistics package used in partial least squares path modeling (PLS) and PLS-based structural equation modeling
SOCR – online tools for teaching statistics and probability theory
Speakeasy (computational environment) – numerical computational environment and programming language with many statistical and econometric analysis features
SPSS Modeler – comprehensive data mining and text analytics workbench
SPSS Statistics – comprehensive statistics package
Stata – comprehensive statistics package
StatCrunch – comprehensive statistics package
Statgraphics – general statistics package to include cloud computing and Six Sigma for use in business development, process improvement, data visualization and statistical analysis, design of experiment, point processes, geospatial analysis, regression, and time series analysis are all included within this complete statistical package.
Statistica – comprehensive statistics package
StatsDirect – statistics package designed for biomedical, public health and general health science uses
StatXact – package for exact nonparametric and parametric statistics
Systat – general statistics package
SuperCROSS – comprehensive statistics package with ad-hoc, cross tabulation analysis
S-PLUS – general statistics package
Unistat – general statistics package that can also work as Excel add-in
The Unscrambler – free-to-try commercial multivariate analysis software for Windows
Visallo - investigative link analysis software
WarpPLS – statistics package used in structural equation modeling
Wolfram Language^[2] – the computer language that evolved from the program Mathematica. It has similar statistical capabilities as Mathematica.
World Programming System (WPS) – statistical package that supports the use of Python, R and SAS languages within in a single user program.
XploRe

Add-ons

Analyse-it – add-on to Microsoft Excel for statistical analysis
NumXL – add-on to Microsoft Excel for statistical and time series analysis
SigmaXL – add-on to Microsoft Excel for statistical and graphical analysis
SPC XL – add-on to Microsoft Excel for general statistics
Statgraphics Sigma Express – add-on to Microsoft Excel for Six Sigma statistical analysis
SUDAAN – add-on to SAS and SPSS for statistical surveys
XLfit add-on to Microsoft Excel for curve fitting and statistical analysis

【首席架构师推荐】统计软件包比较

语言 Chinese, Simplified

下表比较了若干统计分析包的一般资料和技术资料。

General information

Product	Developer	Latest version	Open source	Software license	Interface	Written in	Scripting languages
ADaMSoft	Marco Scarno	27 April 2015	Yes	GNU GPL	CLI, GUI	Java
Alteryx	Alteryx Inc.	2019.2 (June 2019)	No	Proprietary	GUI, Python SDK, js SDK	C#, C++, Python, R, js	R, Python
Analyse-it	Analyse-it		No	Proprietary	GUI	C#, C++, Fortran
ASReml	VSN International	26 March 2014	No	Proprietary	CLI
BMDP	Statistical Solutions		No	Proprietary
Dataplot	Alan Heckert	2013	Yes	Public domain	CLI, GUI	Fortran
ELKI	Ludwig Maximilian University of Munich	0.7.5 (15 February 2019)	Yes	AGPL	CLI, GUI	Java	Shell (computing)
Epi Info	Centers for Disease Control and Prevention	27 June 2016	Yes	Public domain	CLI, GUI	Microsoft C#
EViews	IHS	23 March 2015	No	Proprietary	CLI, GUI
GAUSS	Aptech Systems	2019	No	Proprietary	CLI, GUI	C, C++
GenStat	VSN International	2015	No	Proprietary	CLI, GUI
GraphPad Prism	GraphPad Software, Inc.	February 2009	No	Proprietary	GUI
gretl	The gretl Team	2019c (2 July 2019)	Yes	GNU GPL	CLI, GUI	C	hansl
JASP	JASP team	0.92 (10 December 2018)	Yes	GNU GPL	GUI	C++
JMP	SAS Institute	14.3 (March 2019)	No	Proprietary	GUI, CLI		JSL (JMP Scripting Language)
LIMDEP	Econometric Software, Inc., William Greene	May 2012	No	Proprietary	CLI, GUI	Fortran, C++
Maple	Maplesoft	2019.1 (May 28, 2019; 3 months ago) [±]^[1]	No	Proprietary	CLI, GUI
Mathematica	Wolfram Research	12.0.0 (April 16, 2019; 5 months ago) [±]^[2]	No	Proprietary	CLI, GUI	C, Mathematica
MATLAB	MathWorks	R2018b (12 September 2018)	No	Proprietary	CLI, GUI	C++, Java, MATLAB
MaxStat Pro	MaxStat Software	Pro 3.6	No	Proprietary	GUI	VB.net, C++, C#
MedCalc	MedCalc Software bvba	7 May 2019	No	Proprietary	GUI
Minitab	Minitab Inc.	7 June 2017	No	Proprietary	CLI, GUI
NCSS	NCSS, LLC	February 2015	No	Proprietary	GUI
NLOGIT	Econometric Software, Inc., William Greene	May 2012	No	Proprietary	CLI, GUI	Fortran,C++
NMath Stats	CenterSpace Software	November 2009	No	Proprietary	CLI
NumXL	Spider Financial	14 June 2016	No	Proprietary	GUI	C++, VBA	C, C++, C#, VB, VBA, .NET
OpenEpi	A. Dean, K. Sullivan, M. Soe	22 September 2014	Yes	GNU GPL	GUI	JavaScript, HTML
Orange	Bioinformatics Laboratory, Faculty of Computer and Information Science, University of Ljubljana	10 January 2016	Yes	GNU GPL	GUI/Python	Python, Cython	Python
Origin	OriginLab	28 October 2014	No	Proprietary	GUI	C++	LabTalk
Ox programming language	OxMetrics, J.A. Doornik	August 2011	No	Proprietary	CLI
OxMetrics	OxMetrics, J.A. Doornik	August 2011	No	Proprietary	CLI/GUI
Primer	Primer-E	February 2007	No	Proprietary	GUI
PSPP	GNU Project	1.2.0 (6 November 2018)^[3]	Yes	GNU GPL	CLI, GUI	C	Perl (by PSPP-Perl^[4])
R	R Foundation	3.5.2 (20 December 2018)	Yes	GNU GPL	CLI, GUI^[5]	C, Fortran, R^[6]	R language, Python (by RPy), Perl (by Statistics::R module)
RKWard	RKWard community	0.7.0 (16 April 2018) ^[7]	Yes	GNU GPL	CLI, GUI	C++, ECMAScript	R language, Python (by RPy), Perl (by Statistics::R module)
Revolution Analytics	Norman Nie	2007	Yes	Proprietary	CLI, GUI
RATS	Estima	1 October 2010	No	Proprietary	CLI, GUI
ROOT	ROOT Analysis Framework	4 November 2016	Yes	GNU GPL	GUI	C++	C++, Python
SageMath	>100 developers worldwide	8.8 (27 June 2019; 2 months ago) [±]^[8]	Yes	GNU GPL	CLI & GUI	Python, Cython	Python
Salstat	Alan J. Salmoni, Mark Livingstone	16 May 2014	Yes	GNU GPL	CLI & GUI	Python, NumPy, SciPy	Python
SAS	SAS Institute	9.4M6 (November 2018), Viya 3.4 (September 2018)	No	Proprietary	CLI & GUI	C	SAS language, CAS Language (CASL), APIs for R language, Python, Lua, Java
SciPy	Enthought	1.3.1 (9 August 2019)	Yes	BSD	CLI	Python, C, Fortran	Python
SHAZAM	SHAZAM Analytics Ltd	11.1.4 (April 2015)	No	Proprietary	CLI, GUI	FORTRAN, C++, C
SigmaXL	SigmaXL Inc.	11 March 2019	No	Proprietary	GUI
Skytree Infinity	Skytree, Inc.	26 October 2010	No	Proprietary	CLI, GUI, Java SDK, Python SDK	C++	Shell, Python
SOCR	UCLA and University of Michigan	3.0 (10 May 2015)	Yes	LGPL	GUI	Java
SOFA Statistics	Grant Paton-Simpson	1.5.2 (7 July 2019)	Yes	AGPL	GUI	Python	Python
SPlus	Insightful Inc.	2010	No	Proprietary	CLI
SPSS	IBM	24.0 (15 March 2016)	No	Proprietary	CLI, GUI	Java	R, Python, SaxBasic
Stata	StataCorp LLC	26 June 2019	No	Proprietary	CLI, GUI	C	ado, Mata
StatCrunch	Pearson Education	July 2017	No	Proprietary	GUI
Statgraphics	Statpoint Technologies Incorporated	September 2014	No	Proprietary	GUI	C++
Statistica	Dell Software	September 2015	No	Proprietary	GUI	C++	R, Statistica Visual Basic (SVB)
StatPlus	AnalystSoft	7 January 2007	No	Proprietary	GUI
Statsmodels	Statsmodels Developers	0.9.0 (12 May 2018)	Yes	BSD	CLI	Python, C	Python
SYSTAT	Systat Software Inc.	21 February 2007	No	Proprietary	CLI, GUI
TSP	TSP International	September 2009	No	Proprietary	CLI	Fortran
UNISTAT	Unistat Ltd	8 April 2011	No	Proprietary	GUI, Excel
Winpepi	J. H. Abramson	June 2008	No	Proprietary	GUI
WPS Analytics	World Programming	March 2018	No	Proprietary	CLI, GUI	C, Assembler	Python, R, SAS and SQL languages
WINKS	TexaSoft	August 2013	No	Proprietary	GUI	Fortran, Visual Basic
XploRe	MD*Tech	2006	No	Proprietary	GUI
Product	Developer	Latest version	Open source	Software license	Interface	Written in	Scripting languages

Operating system support

Product	Windows	Mac OS	Linux	BSD	Unix	Cloud
ADaMSoft	Yes	Yes	Yes	Yes	Yes	No
Alteryx	Yes	No	No	No	No	No
Analyse-it	Yes	No	No	No	No	No
BMDP	Yes					No
Dataplot	Yes	Yes	Yes	Yes	Yes	No
ELKI	Yes	Yes	Yes	Yes	Yes	No
Epi Info	Yes	No	No	No	No	No
EViews	Yes	Yes	No	No	No	No
GAUSS	Yes	Yes	Yes	No	Yes	No
GraphPad Prism	Yes	Yes	No	No	No	No
gretl	Yes	Yes	Yes	Yes	No	No
JASP	Yes	Yes	Yes	No	No	browser
JMP	Yes	Yes	Terminated	No	No	No
LIMDEP	Yes	No	No	No	No	No
Maple	Yes	Yes	Yes	No	Yes	No
MATLAB	Yes	Yes	Yes	No	No	No
Mathematica	Yes	Yes	Yes	No	Yes	Yes
MaxStat Pro	Yes	No	No	No	No	No
MedCalc	Yes	No	No	No	No	Yes^[9]
Minitab	Yes	Terminated	No	No	No	No
NCSS	Yes	Yes	No	No	No	No
NLOGIT	Yes	No	No	No	No	No
NMath Stats	Yes	No	No	No	No	No
NumXL	Yes	No	No	No	No	No
OpenEpi	Yes	Yes	Yes	Yes	Yes	No
Orange	Yes	Yes	Yes	Yes	Yes	No
Origin	Yes	No	No	No	No	No
Primer	Yes	No	No	No	No	No
PSPP	Yes	Yes	Yes	Yes	Yes	No
R Commander	Yes^[10]	Yes^[10]	Yes^[10]	Yes^[10]	Yes	No
R	Yes	Yes	Yes	Yes	Yes	Yes
RATS	Yes	Yes	Yes	No	Yes	No
RKWard	Yes	No	Yes	No	Yes	No
ROOT	Yes	Yes	Yes	Yes	Yes	No
SageMath	Partial	Yes	Yes	No	Yes	Yes
Salstat	Yes	Yes	Yes	Yes	Yes	No
SAS	Yes	Terminated	Yes	No	Yes	Yes
SciPy	Yes	Yes	Yes	Yes	Yes	No
SHAZAM	Yes	No	No	No	No	No
SigmaXL	Yes	Yes	No	No	No	No
SOCR	Yes	Yes	Yes	Yes	Yes	No
SOFA Statistics	Yes	Yes	Yes	Yes	Yes	No
SPlus	Yes	No	Yes	No	Yes	No
SPSS	Yes	Yes	Yes	No	Yes	Yes
Stata	Yes	Yes	Yes	No	Yes	No
StatCrunch	Yes	Yes	Yes	Yes	Yes	Yes
Statgraphics	Yes	No	No	No	No	No
Statistica	Yes	No	No	No	No	No
StatPlus	Yes	Yes	No	No	No	No
Statsmodels	Yes	Yes	Yes	Yes	Yes	No
SYSTAT	Yes	Terminated	No	No	No	No
TSP	Yes	Yes	Yes	Yes	Yes	No
UNISTAT	Yes	No	No	No	No	No
The Unscrambler	Yes	No	No	No	No	No
Winpepi	Yes	No	No	No	No	No
WPS Analytics	Yes	Yes	Yes	No	Yes	Yes
WINKS	Yes	No	No	No	No	No
XploRe	Yes	No	Yes	No	Yes	No
Product	Windows	Mac OS	Linux	BSD	Unix	SaaS

ANOVA

Support for various ANOVA methods

Product	One-way	Two-way	MANOVA	GLM	Mixed model	Post-hoc	Latin squares
ADaMSoft	Yes	Yes	No	No	No	No	No
Alteryx	Yes	Yes	Yes	Yes	Yes
Analyse-it	Yes	Yes	No	No	Yes	Yes	No
BMDP	Yes	Yes	Yes	Yes	Yes	Yes
Epi Info	Yes	Yes	No	No	No	No	No
EViews	Yes
GAUSS		No	No	No		No	No
GenStat	Yes	Yes	Yes	Yes	Yes	Yes	Yes
GraphPad Prism	Yes	Yes	No	No		Yes	No
gretl	Yes
JASP	Yes	Yes	No
JMP	Yes	Yes	Yes	Yes	Yes	Yes	Yes
LIMDEP	Yes	Yes	Yes	Yes	Yes	No	No
Maple	Yes^[11]	No	No	No	No	No	Yes^[12]
Mathematica	Yes	Yes	No^[13]	Yes		Yes	No
MATLAB+Statistics Toolbox	Yes	Yes	Yes	Yes	Yes	Yes	Yes
MaxStat Pro	Yes	Yes	No	No	No	Yes	Yes
MedCalc	Yes	Yes	No	Yes		Yes	No
Minitab	Yes	Yes	Yes	Yes		Yes	Yes
NCSS	Yes	Yes	Yes	Yes	Yes	Yes	Yes
NLOGIT	Yes	Yes	Yes	Yes	Yes	No	No
NMath Stats	Yes	Yes	No	No		No	No
Orange	Yes	No	No	No	No	No	No
Origin	Yes	Yes	No	No	Yes	Yes	No
PSPP	Yes	Yes	No	Yes		Yes	Yes
R	Yes	Yes	Yes	Yes	Yes	Yes	Yes
R Commander	Yes	Yes	Yes	Yes		Yes	Yes
SageMath	Yes	Yes	Yes		Yes	Yes
Salstat	Yes	No	No	No		No	No
SAS	Yes	Yes	Yes	Yes	Yes	Yes	Yes
SciPy	Yes	No	No	No	No	No	No
SHAZAM	Yes	Yes	No	Yes	Yes	Yes	No
SigmaXL	Yes	Yes	No	No			No
SOCR	Yes	Yes	No	No		Yes	Yes
SOFA Statistics	Yes	No	No	No		No	No
SPlus	Yes	Yes	Yes	Yes		Yes	Yes
SPSS	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Stata	Yes	Yes	Yes	Yes	Yes	Yes	Yes
StatCrunch	Yes	Yes	No	No	No	Yes	No
Statgraphics	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Statistica	Yes	Yes	Yes	Yes		Yes	Yes
StatPlus	Yes	Yes	Yes	Yes		Yes	Yes
Statsmodels	Yes	Yes	Yes	Yes	Yes	Yes	No
SYSTAT	Yes	Yes	Yes	Yes		Yes	Yes
TSP	No	No	No	No		No	No
UNISTAT	Yes	Yes	No	Yes		Yes	Yes
The Unscrambler	Yes	No	No	No		No	No
WINKS	Yes	Yes	No	Yes	Yes	Yes	No
Winpepi	Yes	Yes	No	No		No	No
WPS Analytics	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Product	One-way	Two-way	MANOVA	GLM	Mixed model	Post-hoc	Latin squares

Regression

Support for various regression methods.

Product	OLS	WLS	2SLS	NLLS	Logistic	GLM	LAD	Stepwise	Quantile	Probit	Cox	Poisson	MLR
ADaMSoft	Yes	Yes	No	Yes	Yes	No	No	Yes
Alteryx	Yes	Yes			Yes	Yes		Yes		Yes
Analyse-it	Yes				Yes								Yes
BMDP	Yes				Yes			Yes			Yes
Epi Info	Yes	No	No	No	Yes	No	No	No			Yes
EViews	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes		Yes	Yes
GAUSS	Yes				Yes	Yes	No		No			Yes
GenStat	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
GraphPad Prism	Yes	Yes	No	Yes	No	No	No	No	No	No		No	Yes
gretl	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes		Yes
JMP	Yes	Yes	No	Yes	Yes	Yes	No	Yes	In JMP Pro	Yes	In JMP Pro	Yes	Yes
LIMDEP	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Maple	Yes	Yes	No	Yes^[14]	No	No	No	No	No	No	No	No	Yes
Mathematica	Yes	Yes		Yes	Yes^[15]	Yes^[16]	Yes^[17]		Yes	Yes^[18]	Yes^[19]	Yes	Yes^[20]
MATLAB+Statistics Toolbox	Yes	Yes	Yes^[21]	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
MaxStat Pro	Yes	Yes		Yes	Yes								Yes
MedCalc	Yes	Yes		Yes	Yes			Yes		Yes	Yes		Yes
Minitab	Yes	Yes	No	Yes	Yes	No	No	Yes	No
NCSS	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
NLOGIT	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
NMath Stats	Yes	Yes		Yes									Yes
NumXL	Yes					Yes		Yes					Yes
Orange	Yes	Yes	No	Yes	Yes	No	No	No	No	No	No	No	Yes
Origin	Yes	Yes	No	Yes	No	No	No	No	No	No	Yes	No	Yes
PSPP	Yes
R	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
R Commander^[22]	Yes					Yes			No
RATS	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes		Yes	Yes
SageMath	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes		Yes
Salstat	No	No	No	No	No	No	No	No	No	No		No	No
SAS	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
SciPy	Yes	via "statsmodels"	No	Yes	No	No	No	Yes	No	via "statsmodels"	No	via "statsmodels"	No
SHAZAM	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
SigmaXL	Yes				Yes								Yes
SOCR	Yes	No	No	No	Yes	No	No	No
SPlus	Yes			Yes	Yes	Yes		Yes	Yes
SPSS	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Stata	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
StatCrunch	Yes	No	No	No	Yes	No	No	No	No	No	No	No	Yes
Statgraphics	Yes	Yes	No	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes
Statistica	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes
StatPlus	Yes	No	Yes	Yes	Yes	Yes	No	Yes
Statsmodels	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes
SYSTAT	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No
TSP	Yes	Yes	Yes	Yes	Yes	No	Yes	No	Yes	Yes		Yes	Yes
UNISTAT	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes		Yes		Yes
The Unscrambler	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
WINKS	Yes				Yes	Yes		Yes					Yes
Winpepi	Yes				Yes					Yes		Yes	Yes
WPS Analytics	Yes	Yes		Yes	Yes	Yes		Yes		Yes	Yes	Yes	Yes
Product	OLS	WLS	2SLS	NLLS	Logistic	GLM	LAD	Stepwise	Quantile	Probit	Cox	Poisson	MLR

Time series analysis

Support for various time series analysis methods.

Product	ARIMA	GARCH	Unit root test	Cointegration test	VAR	Multivariate GARCH
Alteryx	Yes	No
Analyse-it
EViews	Yes	Yes	Yes	Yes	Yes	Yes
GAUSS	Yes	Yes	Yes		Yes	Yes
GraphPad Prism	No	No	No	No	No
gretl	Yes	Yes	Yes	Yes	Yes
JMP	Yes
LIMDEP	Yes	Yes	Yes	Yes	Yes	No
Mathematica	Yes^[23]	Yes	Yes^[24]	Yes	Yes^[25]	Yes^[26]
MATLAB+Econometrics Toolbox	Yes	Yes	Yes	Yes	Yes
MaxStat Pro	Yes	No	No	No	No	No
MedCalc	No	No	No	No	No
Minitab	Yes	No	No	No	No
NCSS	Yes
NLOGIT	Yes	Yes	Yes	Yes	Yes	No
NumXL	Yes	Yes	Yes	Yes
NMath Stats
Orange	Yes	No	No	No	Yes	No
Origin	No	No	No	No	No	No
PSPP
R	Yes	Yes	Yes	Yes	Yes	Yes
R Commander^[22]
RATS	Yes	Yes	Yes	Yes	Yes	Yes
SageMath	Yes	Yes	Yes	Yes	Yes	Yes
Salstat	No	No	No	No	No	No
SAS	Yes	Yes	Yes	Yes	Yes	Yes
SciPy	via "statsmodels"	No	via "statsmodels"	No	via "statsmodels"	No
SHAZAM	Yes	Yes	Yes	Yes	Yes	No
SOCR	No	No	No	No	No
Stata	Yes	Yes	Yes	Yes	Yes	Yes
Statgraphics	Yes	No	No	No	No
Statistica	Yes	No	No	No	No
StatPlus	Yes	No	No	No	No
SPlus		Yes			Yes
SPSS	Yes	Yes
Statsmodels	Yes	No	Yes	Yes	Yes	No
SYSTAT	Yes
TSP	Yes	Yes	Yes	Yes	Yes	No
UNISTAT	Yes	No	No	No	No
WINKS	Yes	No	No	No	No
Winpepi
WPS Analytics	Yes		Yes
Product	ARIMA	GARCH	Unit root test	Cointegration test	VAR	Multivariate GARCH

Charts and diagrams

Support for various statistical charts and diagrams.

Chart	Bar chart	Box plot	Correlogram	Histogram	Line chart	Scatterplot
ADaMSoft	Yes	Yes	Yes	Yes	Yes	Yes
Alteryx	Yes	Yes		Yes	Yes	Yes
Analyse-it	Yes	Yes	Yes	Yes	Yes	Yes
BMDP				Yes		Yes
ELKI	No	No	No	Yes	Yes	Yes
Epi Info	Yes	No	No	Yes	Yes	Yes
EViews	Yes	Yes	Yes	Yes	Yes	Yes
GAUSS	Yes	Yes		Yes	Yes	Yes
GenStat	Yes	Yes	Yes	Yes	Yes	Yes
GraphPad Prism	Yes	Yes	Yes	Yes	Yes	Yes
gretl	Yes	Yes	Yes	Yes	Yes	Yes
JMP	Yes	Yes	Yes	Yes	Yes	Yes
LIMDEP	Yes	Yes	Yes	Yes	Yes	Yes
Maple	Yes^[27]	Yes^[28]	Yes^[29]	Yes^[30]	Yes^[31]	Yes^[32]
Mathematica	Yes^[33]	Yes^[34]	Yes^[35]	Yes^[36]	Yes^[37]	Yes^[38]^[39]
MATLAB+Statistics Toolbox	Yes	Yes	Yes	Yes	Yes	Yes
MaxStat Pro	Yes	Yes	Yes	Yes	Yes	Yes
MedCalc	Yes	Yes	Yes	Yes	Yes	Yes
Minitab	Yes	Yes	Yes	Yes	Yes	Yes
NCSS	Yes	Yes	Yes	Yes	Yes	Yes
NLOGIT	Yes	Yes	Yes	Yes	Yes	Yes
NMath Stats
NumXL			Yes	Yes
Orange	Yes	Yes	Yes	Yes	Yes	Yes
Origin	Yes	Yes	No	Yes	Yes	Yes
PSPP
R	Yes	Yes	Yes	Yes	Yes	Yes
R Commander
RATS	Yes	Yes	Yes	Yes	Yes	Yes
SageMath	Yes	Yes	Yes	Yes	Yes	Yes
SAS	Yes	Yes	Yes	Yes	Yes	Yes
SciPy	Yes	Yes	No	Yes	Yes	Yes
SHAZAM	Yes	Yes	Yes	Yes	Yes	Yes
SigmaXL	Yes	Yes		Yes	Yes	Yes
SOCR	Yes	Yes	Yes	Yes	Yes	Yes
SOFA Statistics	Yes	Yes	No	Yes	Yes	Yes
SPlus
SPSS	Yes	Yes	Yes	Yes	Yes	Yes
Stata	Yes	Yes	Yes	Yes	Yes	Yes
StatCrunch	Yes	Yes	No	Yes	Yes	Yes
Statgraphics	Yes	Yes	Yes	Yes	Yes	Yes
Statistica	Yes	Yes	Yes	Yes	Yes	Yes
StatPlus	Yes	Yes	Yes	Yes	Yes	Yes
Statsmodels	Yes	Yes	Yes	Yes	Yes	Yes
SYSTAT
TSP	No	No	Yes	Yes	Yes	Yes
UNISTAT	Yes	Yes	Yes	Yes	Yes	Yes
The Unscrambler	Yes			Yes	Yes	Yes
WINKS	Yes	Yes	Yes	Yes	Yes	Yes
Winpepi					Yes	Yes
WPS Analytics	Yes	Yes	Yes	Yes	Yes	Yes

Other abilities

Product	s/w type ^{[Note 1]}	Descriptive statistics		Nonparametric statistics		Quality control	Survival analysis			Data processing
Product	s/w type ^{[Note 1]}	Base stat.^{[Note 2]}	Normality tests^{[Note 3]}	CTA^{[Note 4]}	Nonparametric comparison, ANOVA	Quality control	Survival analysis	Cluster analysis	Discriminant analysis	BDP^{[Note 5]}	Ext.^{[Note 6]}
ADaMSoft	S	+	+	+	+	-	-	+	+	+	+
Alteryx	S	+	+	+	+	+	+	+	+	+	+
Analyse-it	X	+	+	+	+	+	-	-	-	+	+
BMDP		+	+	+	+		+	+	+
Epi Info	S	+	-	+	+	-	+	-	-	+	+
Gauss	St	+	+	-	-	-	-	-	-	+	+
GenStat	St	+	+	+	+	+	+	+	+	+	+
GraphPad Prism	S	+	+	-	+	-	+	-	-	-	-
Gretl	S	+	+	+	+	-	+	-	-	+	+
JMP	S	+	+	+	+	+	+	+	+	+	+
LIMDEP	S	+	+	+	+	-	-	+	+	+	+
Maple	S	+	+^[40]			+^[41]	-	-	-	+	+
Mathematica	S	+	+	+	+	-	+^[42]	+	-	+	+
MATLAB+Statistics Toolbox	S	+	+	+	+	+	+	+	+	+	+
MaxStat Pro	S	+	+	+	+		-	-	-	+	+
MedCalc	S	+	+	+	+	+	+	-	-	+	+
Minitab	S	+	+	+	+	+	+	+	+	+	+
NCSS	S	+	+	+	+	+	+	+	+	+	+
NLOGIT	S	+	+	+	+	-	-	+	+	+	+
NMath Stats	S	+	+	-	-	-	-	+	-	-	-
NumXL	X	+	+	-	-	-	-	-	-	-	+
OpenEpi	S	+	-	+	-	-	-	-	-	-	-
Orange	S	+	+	+	+	+	-	+	+	+	+
Origin	S	+	+	-	+	-	+	+	+	+	+
PSPP	S	+	+
R	St	+	+	+	+	+	+	+	+	+	+
RATS		+	+	-	-	-	-	-	-	+	+
SAS	S	+	+	+	+	+	+	+	+	+	+
SciPy	St	+	+	-	+	-	-	-	-	+	+
SHAZAM	S	+	+	-	-	-	-	-	-	+	+
SigmaXL	X	+	+	+	+	+	+			+	+
SOCR	S	+	+	+	+	-	+	+	-	+	+
SOFA Statistics	S		-	+	+	-	-	-	-	-	-
Stata	S	+	+	+	+	+	+	+	+	+	+
StatCrunch	C	+	+	+	+	+	-	-	-	+	+
Statgraphics	S	+	+	+	+	+	+	+	+	+	+
Statistica	S	+	+	+	+	+	+	+	+	+	+
StatPlus	S	+	+	+	+	+	+	-	-	+	+
SPlus	St	+	+	+	+	+	+	+	+	+	+
SPSS	S	+	+	+	+	+	+	+	+	+	+
Statsmodels	St	+	+	+	-	-	+	-	-	+	+
SYSTAT	S	+	+	+	+	+	+	+	+	+	+
TSP	S	+	+	-	-	-	-	-	-	+	+
UNISTAT	S	+	+	+	+	+	+	+	+	+	+
The Unscrambler	S	+	+		+			+	+
WINKS	S	+	+	+	+	+	+			+	+
Winpepi	S	+	+	+	+	-	+	+	-	-	-
WPS Analytics	S	+	+	+	+		+	+	+	+	+
Product	s/w type ^{[Note 1]}	Descriptive statistics		Nonparametric statistics		Quality control	Survival analysis			Data processing
Product	s/w type ^{[Note 1]}	Base stat.^{[Note 2]}	Normality tests^{[Note 3]}	CTA^{[Note 4]}	Nonparametric comparison, ANOVA	Quality control	Survival analysis	Cluster analysis	Discriminant analysis	BDP^{[Note 5]}	Ext.^{[Note 6]}

【首席架构师推荐】计算代数系统列表

语言 Chinese, Simplified

下表提供了计算机代数系统(CAS)的比较。CAS是一个包，包含一组算法，用于对代数对象执行符号操作，一种语言来实现它们，以及使用该语言的环境。CAS可以包括用户界面和图形功能;要想有效，可能需要大量的算法库、高效的数据结构和一个快速的内核

General

System	Creator	Development started	First public release	Latest stable version	Latest stable release date	Cost (USD)	License	Notes
Axiom	Richard Jenks	1977	1993 and 2002^[7]		August 2014^[8]	Free	modified BSD license	General purpose CAS. Continuous Release using Docker Containers
Cadabra	Kasper Peeters	2001	2007	2.2.0	29 March 2018	Free	GNU GPL	CAS for tensor field theory
CoCoA	John Abbott, Anna M. Bigatti, Giovanni Lagorio	1987	1995	5.2.0	2 May 2017	Free	GNU GPL	Specialized CAS for commutative algebra
Derive	Soft Warehouse	1979	1988	6.1	November 2007	Discontinued	Proprietary	CAS designed for pocket calculators; it was discontinued in 2007
Erable (aka ALGB)	Bernard Parisse, Mika Heiskanen, Claude-Nicolas Fiechter	1993	1993	4.20060919	21 April 2009	Free	LGPL	CAS designed for Hewlett-Packard scientific graphing calculators of the HP 48/49/40/50 series; discontinued in 2009
Fermat	Robert H. Lewis	1986	1993	6.21	13 July 2018	$70 if grant money available, otherwise $0	GNU GPL	Specialized CAS for resultant computation and linear algebra with polynomial entries
FORM	J.A.M. Vermaseren	1984	1989	4.2	6 July 2017^[9]	Free	GNU GPL	CAS designed mainly for particle physics
FriCAS	Waldek Hebisch	2007	2007	1.3.5	3 February 2019	Free	modified BSD license	Full-featured general purpose CAS. Especially strong at symbolic integration.
GAP	GAP Group	1986	1986	4.9.3	5 September 2018	Free	GNU GPL^[10]	Specialized CAS for group theory and combinatorics.
GiNaC	Christian Bauer, Alexander Frink, Richard B. Kreckel, et al.	1999	1999	1.7.5	17 February 2019	Free	GNU GPL	Integrate symbolic computation into C++ programs; no high-level interface, but emphasis on interoperability.
KANT/KASH	KANT Group	?	?	3	2005/2008	Free for non-commercial use	own license	Specialized CAS for algebraic number theory
Macaulay2	Daniel Grayson and Michael Stillman	1992	1994	1.14	2019	Free	GNU GPL	Specialized CAS for algebraic geometry and commutative algebra
Macsyma	MIT Project MAC and Symbolics	1968	1978	2.4	1999	$500	Proprietary	The oldest general purpose CAS. Still alive as Maxima.
Magma	University of Sydney	~1990	1993	2.22-3	20 July 2016	$1,440	Proprietary	General purpose CAS, originally specialized in group theory. Works with elements of algebraic structures rather than with non typed mathematical expressions
Magnus	The New York Group Theory Cooperative	1994	1997		2005	Free	GNU GPL	Specialized CAS for group theory providing facilities for doing calculations in and about infinite groups. Discontinued in 2005.
Maple	Symbolic Computation Group, University of Waterloo	1980	1984	2019.1 (May 28, 2019; 3 months ago) [±]^[11]	14 March 2019	$2,390(Commercial), $2,265 (Government), $995 (Academic), $239 (Personal Edition), $99 (Student), $79 (Student, 12-Month term)^[12]	Proprietary	One of the major general purpose CAS
Mathcad	Parametric Technology Corporation	1985	1985	15.0 M045	November 2015	$1,600 (Commercial), $105 (Student), Free (Express Edition)^[13]	Proprietary	Numerical software with some CAS capabilities
Mathematica	Wolfram Research	1986	1988	12.0.0 (April 16, 2019; 5 months ago) [±]^[14]	16 April 2019	$2,495 (Professional), $1095 (Education), $295 (Personal),^[15] $140 (Student), $69.95 (Student annual license),^[16] free on Raspberry Pi hardware^[17]	Proprietary	One of the major general purpose CAS
Mathomatic	George Gesslein II	1986	1987	16.0.5	2012	Discontinued	LGPL	Elementary algebra, calculus, complex number and polynomial manipulations.
Maxima	MIT Project MAC and Bill Schelter et al.	1967	1998	5.42.0	22 January 2019	Free	GNU GPL	General purpose CAS. Continuation of Macsyma; new releases occur two times a year.
MuMATH	Soft Warehouse	1970s	1980	MuMATH-83		Discontinued	Proprietary	Predecessor of Derive
MuPAD	SciFace Software	1989	2008	5.1	2008	Discontinued	Proprietary	MathWorks has incorporated MuPAD technology into Symbolic Math Toolbox
OpenAxiom	Gabriel Dos Reis	2007	2007	1.4.2	2013	Free	modified BSD license	General purpose CAS. A fork of Axiom.
PARI/GP	Henri Cohen, Karim Belabas, Bill Allombert et al.	1985	1990	2.11.0	18 July 2018	Free	GNU GPL	Specialized CAS for number theory.
Reduce	Anthony C. Hearn	1960s	1968		2018	Free	modified BSD license	Historically important general purpose CAS. Still alive, as open-sourced and freed in December 2008
Scilab	Scilab Enterprises	1990	1990	6.0.2	14 February 2019	Free	CeCILL (GPL-compatible)	Matlab alternative.
SageMath	William A. Stein	2005	2005	8.8	27 June 2019^[18]	Free	GNU GPL	Mathematics software system combining a number of existing packages, including numerical computation, statistics and image processing
SINGULAR	University of Kaiserslautern	1984	1997	4-1-2	25 March 2019	Free	GNU GPL	Computer algebra system for polynomial computations, with special emphasis on commutative and non-commutative algebra, algebraic geometry, and singularity theory.
SMath Studio	Andrey Ivashov	2004	2006	0.99.6839	22 September 2018	Free	Proprietary	Mathematical notebook program similar to Mathcad.
Symbolic Math Toolbox (MATLAB)	MathWorks	1989	2008	9.4(2018a)	2018	$3,150 (Commercial), $99 (Student Suite), $700 (Academic), $194 (Home) including required Matlab	Proprietary	Provides tools for solving and manipulating symbolic math expressions and performing variable-precision arithmetic.
SymPy	Ondřej Čertík	2006	2007	1.4	10 April 2019	Free	modified BSD license	Python-based
TI-Nspire CAS (Computer Software)	Texas Instruments	2006	2009	3.1.0.392			Proprietary	Successor to Derive. Based on Derive's engine used in TI-89/Voyage 200 and TI-Nspire handheld
Wolfram Alpha	Wolfram Research		2009		2013	Pro version: $4.99 / month, Pro version for students: $2.99 / month, ioRegular version: free	Proprietary	Online computer algebra system with step-by step solutions.
Xcas/Giac	Bernard Parisse	2000	2000	1.2.3	January 2017	Free	GPL	General CAS, also adapted for the HP Prime. Compatible modes for Maple, MuPAD and TI89 syntax. Symbolic spreadsheets, Giac library for use with other programs. ARM ports for some PDAs with Linux or WinCE^[19]
Yacas	Ayal Pinkus et al.	1998^[20]	1999	1.7.0	26 June 2019	Free	GNU GPL
	Creator	Development started	First public release	Latest stable version	Latest stable release date	Cost (USD)	License	Notes

These computer algebra systems are sometimes combined with "front end" programs that provide a better user interface, such as the general-purpose GNU TeXmacs.

Functionality

Below is a summary of significantly developed symbolic functionality in each of the systems.

System	Formula editor	Arbitrary precision	Calculus		Solvers					Graph theory	Number theory	Quantifier elimination	Boolean algebra	Tensors	Probability	Control theory	Coding theory	Group theory	System
System	Formula editor	Arbitrary precision	Integration	Integral transforms	Equations	Inequalities	Diophantine equations	Differential equations	Recurrence relations	Graph theory	Number theory	Quantifier elimination	Boolean algebra	Tensors	Probability	Control theory	Coding theory	Group theory	System
Axiom	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	No	No	Yes	Axiom
Cadabra	No	Yes	Yes	Yes	Yes	Yes	No	Yes	No	No	No	No	No	Yes	No	No	No	Yes	Cadabra
FriCAS	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	Yes	FriCAS
Magma	No	Yes	No	No	Yes	No	Yes	No	No	Yes	Yes	No	No	No	?	?	Yes	Yes	Magma
Magnus	No	Yes	No	No	No	No	No	No	No	?	?	No	?	No	No	No	No	Yes	Magnus
Maple	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	No	Yes	Maple
Mathcad	Yes	No	Yes	No	Yes	No	No	No	No	No	No	No	No	No	No	No	No	No	Mathcad
Mathematica	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes^[21]	Yes	Yes	No	Yes	Mathematica
Mathomatic	No	No	Yes	Yes	Yes	No	No	No	No	No	Yes	No	No	No	No	No	No	No	Mathomatic
Symbolic Math Toolbox (MATLAB)	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	No	Yes	No	Yes	Yes	No	No	Symbolic Math Toolbox (MATLAB)
Maxima	No	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	No	Yes	Maxima
SageMath	No	Yes	Yes	Yes	Yes	Yes	Yes^[A]	Yes	Yes	Yes	Yes	Yes^[B]	Yes	Yes	Yes	No	Yes	Yes	SageMath
SMath Studio	Yes	No	Yes	No	Yes	No	No	No	No	No	No	No	No	No	No	No	No	No	SMath Studio
SymPy	No	Yes	Yes	Yes	Yes	Yes	Yes^[22]	Yes	Yes	No	Yes	No	Yes	Yes	Yes	No	No	Yes	SymPy
Wolfram Alpha	Pro version only	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	?	?	No	Yes	Wolfram Alpha
GAP	No	Yes	No	No	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	No	No	Yes	Yes	GAP
Xcas/Giac	Yes	Yes	Yes	No	Yes	Yes	No	Yes	Yes	No	Yes	No	No	No	Yes	?	No	?	Xcas/Giac
Yacas	No	Yes	Yes	No	Yes	No	No	No	No	No	No	No	No	No	?	?	No	No	Yacas
Reduce	No	Yes	Yes	?	Yes	Yes	?	Yes	?	?	Yes	Yes	Yes	Yes	?	?	?	?	Reduce

^{^} via SymPy
^{^} via qepcad optional package

Those which do not "edit equations" may have a GUI, plotting, ASCII graphic formulae and math font printing. The ability to generate plaintext files is also a sought-after feature because it allows a work to be understood by people who do not have a computer algebra system installed.

Operating system support

The software can run under their respective operating systems natively without emulation. Some systems must be compiled first using an appropriate compiler for the source language and target platform. For some platforms, only older releases of the software may be available.

System	DOS	Windows	macOS	Linux	BSD	Solaris	Android	iOS	SaaS	Other
Axiom	?	Emulator	Yes	Yes	No	No	?	?	No
Cadabra	No	Yes	Yes	Yes	Yes	No	No	No	No
CoCoA	No	Yes	Yes	Yes	Yes	Yes	?	?	No	Tru64 UNIX, HP-UX, IRIX
Derive	Yes	Yes	No	No	No	No	?	?	No
Erable	No	Emulator	Emulator	Emulator	No	No	No	No	No	System RPL on HP 48/49/50/40 series
Euler	?	Yes	No	Yes	No	No	?	?	No
Fermat	?	Cygwin	Yes	Yes	No	No	?	?	No
FORM	?	Cygwin	Yes	Yes	Yes	Yes	?	?	No
FriCAS	?	Cygwin+native	Yes	Yes	Yes	Yes	?	?	No
GAP	?	Yes	Yes	Yes	Yes	Yes	?	?	No
KANT/KASH	?	Yes	Yes	Yes	No	No	?	?	No
Macaulay2	?	Cygwin	Yes	Yes	Yes	Yes	?	?	No
Magma	?	Yes	Yes	Yes	Yes	Yes	?	?	No
Magnus	No	Yes	?	Yes	?	Yes	No	No	No	SunOs
Maple	No	Yes	Yes	Yes	No	No	No	No	No
Mathcad	Yes	Yes	No	No	No	No	No	No	No
Mathematica	No	Yes	Yes	Yes	No	No	No	No	Yes	Raspberry Pi^[17]
Mathomatic	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	No	All POSIX platforms
Maxima	?	Yes	Yes	Yes	Yes	Yes	Yes	?	No	All POSIX platforms with Common Lisp
MuMATH	Yes	No	No	No	No	No	?	?	No
OpenAxiom	?	Yes	Yes	Yes	Yes	Yes	?	?	No
PARI/GP	?	Yes	Yes	Yes	Yes	Yes	Yes	?	No
Reduce	?	Yes	Yes	Yes	Yes	Yes	?	?	No
SageMath	No	Yes	Yes	Yes	No	Yes	No	Yes	Yes
SINGULAR	?	Yes	Yes	Yes	Yes	Yes	?	?	No
SMath Studio	No	Yes	Mono	Mono	Mono	Mono	Yes	Yes	Yes	Universal Windows Platform
SymbolicC++	?	Yes	Yes	Yes	Yes	Yes	?	?	No
Symbolic Math Toolbox (MATLAB)	No	Yes	Yes	Yes	No	No	No	No	Yes
SymPy	?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes^[23]	Any system that supports Python
TI-Nspire (desktop software)	No	Yes	Yes	No	No	No	No	Yes	No
Xcas/Giac	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	HP Prime CAS, KhiCAS for TI Nspire
Yacas	No	Yes	Yes	Yes	Yes	Yes	?	?	No

Graphing calculators

Some graphing calculators have CAS features.

System	Creator	Development started	First public release / OS version	Latest stable version / OS version	Notes
Casio CFX-9970G	CASIO Computer Co.	?	1998
Casio Algebra FX 2.0	CASIO Computer Co.	?	1999
Casio ClassPad 300, Casio ClassPad 300 Plus, Casio ClassPad 330, Casio ClassPad 330 Plus, Casio ClassPad fx-CP400 Casio ClassPad Manager	CASIO Computer Co.	2002	2003	3.10.7000	ClassPad Manager is an emulator which runs on a PC.
HP 49G, HP 49g+, HP 48gII, HP 50g, HP 40G, HP 40gs	Hewlett-Packard	1993	1.??(1999) / 4	2.15 (2006-09-19, 2009-04-21) / 4	Based on Erable, which is also available as an add-on for the HP 48S, HP 48SX, HP 48G, HP 48G+, HP 48GX. Intended for problems which occur in engineering applications. Source code openly available.
HP Prime	Hewlett-Packard	2000	2013	6975 (2014-12-03) / v1.1.0-46 (2014-03-31)	Based on Xcas/Giac. Source code openly available.
TI-89	Texas Instruments	1995	1996	2.09
TI-89 Titanium	Texas Instruments	2003	2004	7/18/2005 v3.10
TI-92	Texas Instruments	1994	1995	?
TI-92 Plus	Texas Instruments	1997	1998	3/27/2003 v2.09
TI-Nspire CAS, TI-Nspire CX CAS	Texas Instruments	2006	2008	2014 v3.6.0.550
Voyage 200	Texas Instruments	2001	2002	7/18/2005 v3.10

【首席架构师精选】图型可视化软件

语言 Chinese, Simplified

图型可视化软件

B

C

D

G

J

JUNG

M

N

P

PGF/TikZ

R

Rigi (software)

S

T

Tulip (software)

V

Visone (software)

W

WikiNodes

Y

原文：https://en.wikipedia.org/wiki/Category:Graph_drawing_software

本文：

讨论：请加入知识星球或者小红圈【首席架构师圈】

25 次浏览

SEO Title

wikipedia Graph drawing software

【首席架构师精选】精选数据可视化软件列表

语言 Chinese, Simplified

精选数据可视化软件列表

A

C

D

E

F

G

H

I

J

K

L

M

O

P

Q

Qlik
Qunb

R

S

T

V

W

Wolfram Language

原文：https://en.wikipedia.org/wiki/Category:Data_visualization_software

本文：https://pub.intelligentx.net/wikipedia-data-visualization-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

29 次浏览

SEO Title

wikipedia Data visualization software

【首席架构师精选】精选绘图软件

语言 Chinese, Simplified

精选绘图软件

List of information graphics software

A

C

D

E

F

FlexPro

G

I

L

LabPlot

M

N

NuCalc

O

P

Q

QtiPlot

R

ROOT

S

T

V

Veusz
VisIt

W

X

XLfit

原文：https://en.wikipedia.org/wiki/Category:Plotting_software

本文：https://pub.intelligentx.net/wikipedia-plotting-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

37 次浏览

SEO Title

wikipedia Plotting software

【首席架构师精选】精选统计软件列表

语言 Chinese, Simplified

精选统计软件列表

A

ASReml

B

BLUPF90
BMDP

C

CumFreq

D

Design–Expert

E

Epidata

F

G

I

Imputation and Variance Estimation Software

L

LISREL

M

N

P

S

T

U

V

ViSta, The Visual Statistics system

W

X

XLispStat

原文：https://en.wikipedia.org/wiki/Category:Statistical_software

本文：https://pub.intelligentx.net/wikipedia-statistical-software

讨论：请加入知识星球或者小红圈【首席架构师圈】

41 次浏览

SEO Title

wikipedia Statistical software

数据工具

【ETL工具】精选的ETL（提取，转换，加载）框架，库和软件的精选列表。

awesome-etl

Related Lists

Workflow Management/Engines

Job Scheduling

Java

Python

Libraries

Talks/Articles

Ruby

Go

Javascript

Talks/Articles

Cloud Services

Big Data (Hadoop Stack)

ETL Tools (GUI)

【工作流工具】精选计算数据分析工作流系统

Computational Data Analysis Workflow Systems

An incomplete list

【机器学习精选】精选的机器学习框架，库和软件的精选列表。

Awesome Machine Learning

Table of Contents

Frameworks and Libraries

Tools

APL

General-Purpose Machine Learning

C

General-Purpose Machine Learning

Computer Vision

C++

Computer Vision

General-Purpose Machine Learning

Natural Language Processing

Speech Recognition

Sequence Analysis

Gesture Detection

Common Lisp

General-Purpose Machine Learning

Clojure

Natural Language Processing

General-Purpose Machine Learning

Data Analysis / Data Visualization

Crystal

General-Purpose Machine Learning

Elixir

General-Purpose Machine Learning

Natural Language Processing

Erlang

General-Purpose Machine Learning

Go

Natural Language Processing

General-Purpose Machine Learning

Spatial analysis and geometry

Data Analysis / Data Visualization

Computer vision

Haskell

General-Purpose Machine Learning

Java

Natural Language Processing

General-Purpose Machine Learning

Speech Recognition

Data Analysis / Data Visualization

Deep Learning

Javascript

Natural Language Processing

Data Analysis / Data Visualization

General-Purpose Machine Learning

Misc

Demos and Scripts

Julia

General-Purpose Machine Learning

Natural Language Processing

Data Analysis / Data Visualization

Misc Stuff / Presentations

Lua

General-Purpose Machine Learning

Demos and Scripts

Matlab

Computer Vision