r/MLNotes • • Jun 06 '20

A Beginner's Guide to Python Machine Learning and Data Science Frameworks

8 Upvotes

A Beginner's Guide to Python Machine Learning and Data Science Frameworks

All libraries below are free, and most are open-source.

Table of contents:

Learn to build AI apps now »

Machine Learning

General purpouse Machine Learning

  • scikit-learn - machine learning in Python

  • Shogun - machine learning toolbox

  • xLearn - High Performance, Easy-to-use, and Scalable Machine Learning Package

  • Reproducible Experiment Platform (REP) - Machine Learning toolbox for Humans

  • modAL - a modular active learning framework for Python3

  • Sparkit-learn - PySpark + Scikit-learn = Sparkit-learn

  • mlpack - a scalable C++ machine learning library (Python bindings)

  • dlib - A toolkit for making real world machine learning and data analysis applications in C++ (Python bindings)

  • MLxtend - extension and helper modules for Python’s data analysis and machine learning libraries

  • tick - module for statistical learning, with a particular emphasis on time-dependent modelling

  • sklearn-extensions - a consolidated package of small extensions to scikit-learn

  • civisml-extensions - scikit-learn-compatible estimators from Civis Analytics

  • scikit-multilearn - multi-label classification for python

  • tslearn - machine learning toolkit dedicated to time-series data

  • seqlearn - seqlearn is a sequence classification toolkit for Python

  • pystruct - Simple structured learning framework for python

  • sklearn-expertsys - Highly interpretable classifiers for scikit learn, producing easily understood decision rules instead of black box models

  • skutil - A set of scikit-learn and h2o extension classes (as well as caret classes for python)

  • sklearn-crfsuite - scikit-learn inspired API for CRFsuite

  • RuleFit - implementation of the rulefit

  • metric-learn - metric learning algorithms in Python

  • pyGAM - Generalized Additive Models in Python

  • luminol - Anomaly Detection and Correlation library

Automated machine learning

  • TPOT - Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming

  • auto-sklearn - is an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator

  • MLBox - a powerful Automated Machine Learning python library.

Ensemble methods

  • ML-Ensemble - high performance ensemble learning

  • brew - Python Ensemble Learning API

  • Stacking - Simple and useful stacking library, written in Python.

  • stacked_generalization - library for machine learning stacking generalization.

  • vecstack - Python package for stacking (machine learning technique)

Imbalanced datasets

  • imbalanced-learn - module to perform under sampling and over sampling with various techniques

  • imbalanced-algorithms - Python-based implementations of algorithms for learning on imbalanced data.

Random Forests

Extreme Learning Machine

  • Python-ELM - Extreme Learning Machine implementation in Python

  • Python Extreme Learning Machine (ELM) - a machine learning technique used for classification/regression tasks

  • hpelm ![alt text][gpu] - High performance implementation of Extreme Learning Machines (fast randomized neural networks).

Kernel methods

  • pyFM - Factorization machines in python

  • fastFM - a library for Factorization Machines

  • tffm - TensorFlow implementation of an arbitrary order Factorization Machine

  • liquidSVM - an implementation of SVMs

  • scikit-rvm - Relevance Vector Machine implementation using the scikit-learn API

Gradient boosting

  • XGBoost ![alt text][gpu] - Scalable, Portable and Distributed Gradient Boosting

  • LightGBM ![alt text][gpu] - a fast, distributed, high performance gradient boosting by Microsoft

  • CatBoost ![alt text][gpu] - an open-source gradient boosting on decision trees library by Yandex

  • InfiniteBoost - building infinite ensembles with gradient descent

  • TGBoost - Tiny Gradient Boosting Tree

Deep Learning

Keras

  • Keras - a high-level neural networks API, written in Python and capable of running on top of TensorFlow, CNTK, or Theano

  • keras-contrib - Keras community contributions

  • Hyperas - Keras + Hyperopt: A very simple wrapper for convenient hyperparameter

  • Elephas - Distributed Deep learning with Keras & Spark

  • Hera - Train/evaluate a Keras model, get metrics streamed to a dashboard in your browser.

  • dist-keras - Distributed Deep Learning, with a focus on distributed training

  • Conx - The On-Ramp to Deep Learning

PyTorch

  • PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • torchvision - Datasets, Transforms and Models specific to Computer Vision

  • torchtext - Data loaders and abstractions for text and NLP

  • torchaudio - an audio library for PyTorch

  • ignite - high-level library to help with training neural networks in PyTorch

  • PyToune - a Keras-like framework and utilities for PyTorch

  • skorch - a scikit-learn compatible neural network library that wraps pytorch

  • PyTorchNet - an abstraction to train neural networks

  • Aorun - intend to implement an API similar to Keras with PyTorch as backend.

  • pytorch_geometric - Geometric Deep Learning Extension Library for PyTorch

Tensorflow

  • TensorFlow - Computation using data flow graphs for scalable machine learning by Google

  • TensorLayer - Deep Learning and Reinforcement Learning Library for Researcher and Engineer.

  • TFLearn - Deep learning library featuring a higher-level API for TensorFlow

  • Sonnet - TensorFlow-based neural network library by DeepMind

  • TensorForce - a TensorFlow library for applied reinforcement learning

  • tensorpack - a Neural Net Training Interface on TensorFlow

  • Polyaxon - a platform that helps you build, manage and monitor deep learning models

  • Horovod - Distributed training framework for TensorFlow

  • tfdeploy - Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy

  • hiptensorflow ![alt text][amd] - ROCm/HIP enabled Tensorflow

  • TensorFlow Fold - Deep learning with dynamic computation graphs in TensorFlow

  • tensorlm - wrapper library for text generation / language models at char and word level with RNN

  • TensorLight - a high-level framework for TensorFlow

  • Mesh TensorFlow - Model Parallelism Made Easier

Theano

Warning: Theano development has ceased

  • Theano - is a Python library that allows you to define, optimize, and evaluate mathematical expressions

  • Lasagne - Lightweight library to build and train neural networks in Theano Lasagne add-ons…

  • nolearn - scikit-learn compatible neural network library (mainly for Lasagne)

  • Blocks - a Theano framework for building and training neural networks

  • platoon - Multi-GPU mini-framework for Theano

  • NeuPy - NeuPy is a Python library for Artificial Neural Networks and Deep Learning

  • scikit-neuralnetwork - Deep neural networks without the learning cliff

  • Theano-MPI - MPI Parallel framework for training deep learning models built in Theano

MXNet

  • MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler

  • Gluon - a clear, concise, simple yet powerful and efficient API for deep learning (now included in MXNet)

  • MXbox - simple, efficient and flexible vision toolbox for mxnet framework.

  • gluon-cv - provides implementations of the state-of-the-art deep learning models in computer vision.

  • gluon-nlp - NLP made easy

  • MXNet ![alt text][amd] - HIP Port of MXNet

Caffe

  • Caffe - a fast open framework for deep learning

  • Caffe2 - a lightweight, modular, and scalable deep learning framework

  • hipCaffe ![alt text][amd] - the HIP port of Caffe

CNTK

  • CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Chainer

  • Chainer - a flexible framework for neural networks

  • ChainerRL - a deep reinforcement learning library built on top of Chainer.

  • ChainerCV - a Library for Deep Learning in Computer Vision

  • ChainerMN - scalable distributed deep learning with Chainer

  • scikit-chainer - scikit-learn like interface to chainer

  • chainer_sklearn - Sklearn (Scikit-learn) like interface for Chainer

Others

  • SKIL Skymind’s platform for distributed training of machine learning models, tracking machine learning experiments, deploying models to production and managing them over their lifecycle.

  • Neon - Intel Nervana™ reference deep learning framework committed to best performance on all hardware

  • Tangent - Source-to-Source Debuggable Derivatives in Pure Python

  • autograd - Efficiently computes derivatives of numpy code

  • Myia - deep learning framework (pre-alpha)

  • nnabla - Neural Network Libraries by Sony

Model explanation

  • Auralisation - auralisation of learned features in CNN (for audio)

  • CapsNet-Visualization - a visualization of the CapsNet layers to better understand how it works

  • lucid - a collection of infrastructure and tools for research in neural network interpretability.

  • Netron - visualizer for deep learning and machine learning models (no Python code, but visualizes models from most Python Deep Learning frameworks)

  • FlashLight - visualization Tool for your NeuralNetwork

  • tensorboard-pytorch - tensorboard for pytorch (and chainer, mxnet, numpy, …)

  • anchor - code for “High-Precision Model-Agnostic Explanations” paper

  • aequitas - Bias and Fairness Audit Toolkit

  • Contrastive Explanation - Contrastive Explanation (Foil Trees)

  • yellowbrick - visual analysis and diagnostic tools to facilitate machine learning model selection

  • scikit-plot - an intuitive library to add plotting functionality to scikit-learn objects

  • shap - a unified approach to explain the output of any machine learning model

  • ELI5 - a library for debugging/inspecting machine learning classifiers and explaining their predictions

  • Lime - Explaining the predictions of any machine learning classifier

  • FairML - FairML is a python toolbox auditing the machine learning models for bias

  • L2X - Code for replicating the experiments in the paper Learning to Explain: An Information-Theoretic Perspective on Model Interpretation

  • PDPbox - partial dependence plot toolbox

  • pyBreakDown - Python implementation of R package breakDown

  • PyCEbox - Python Individual Conditional Expectation Plot Toolbox

  • Skater - Python Library for Model Interpretation

  • tensorflow/model-analysis - Model analysis tools for TensorFlow

  • themis-ml - a library that implements fairness-aware machine learning algorithms

  • treeinterpreter [alt text][skl] -interpreting scikit-learn’s decision tree and random forest predictions

Reinforcement Learning

  • OpenAI Gym - a toolkit for developing and comparing reinforcement learning algorithms.

Distributed computing systems

  • PySpark - exposes the Spark programming model to Python

  • Veles - Distributed machine learning platform by Samsung

  • Jubatus - Framework and Library for Distributed Online Machine Learning

  • DMTK - Microsoft Distributed Machine Learning Toolkit

  • PaddlePaddle - PArallel Distributed Deep LEarning by Baidu

  • dask-ml - Distributed and parallel machine learning

  • Distributed - Distributed computation in Python

Probabilistic methods

  • pomegranate ![alt text][cp] - probabilistic and graphical models for Python

  • pyro - a flexible, scalable deep probabilistic programming library built on PyTorch.

  • ZhuSuan - Bayesian Deep Learning

  • PyMC - Bayesian Stochastic Modelling in Python

  • PyMC3 - Python package for Bayesian statistical modeling and Probabilistic Machine Learning

  • sampled - Decorator for reusable models in PyMC3

  • Edward - A library for probabilistic modeling, inference, and criticism.

  • InferPy - Deep Probabilistic Modelling Made Easy

  • GPflow - Gaussian processes in TensorFlow

  • PyStan - Bayesian inference using the No-U-Turn sampler (Python interface)

  • gelato - Bayesian dessert for Lasagne

  • sklearn-bayes - Python package for Bayesian Machine Learning with scikit-learn API

  • bayesloop - Probabilistic programming framework that facilitates objective model selection for time-varying parameter models

  • PyFlux - Open source time series library for Python

  • skggm - estimation of general graphical models

  • pgmpy - a python library for working with Probabilistic Graphical Models.

  • skpro - supervised domain-agnostic prediction framework for probabilistic modelling by The Alan Turing Institute

  • Aboleth - a bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation

  • PtStat - Probabilistic Programming and Statistical Inference in PyTorch

  • PyVarInf - Bayesian Deep Learning methods with Variational Inference for PyTorch

  • emcee - The Python ensemble sampling toolkit for affine-invariant MCMC

  • hsmmlearn - a library for hidden semi-Markov models with explicit durations

  • pyhsmm - bayesian inference in HSMMs and HMMs

  • GPyTorch - a highly efficient and modular implementation of Gaussian Processes in PyTorch

  • Bayes - Python implementations of Naive Bayes algorithm variants

Genetic Programming

  • gplearn - Genetic Programming in Python

  • DEAP - Distributed Evolutionary Algorithms in Python

  • karoo_gp - A Genetic Programming platform for Python with GPU support

  • monkeys - A strongly-typed genetic programming framework for Python

  • sklearn-genetic - Genetic feature selection module for scikit-learn

Optimization

  • Spearmint - Bayesian optimization

  • SMAC3 - Sequential Model-based Algorithm Configuration

  • Optunity - is a library containing various optimizers for hyperparameter tuning.

  • hyperopt - Distributed Asynchronous Hyperparameter Optimization in Python

  • hyperopt-sklearn - hyper-parameter optimization for sklearn

  • sklearn-deap - use evolutionary algorithms instead of gridsearch in scikit-learn

  • sigopt_sklearn - SigOpt wrappers for scikit-learn methods

  • Bayesian Optimization - A Python implementation of global optimization with gaussian processes.

  • SafeOpt - Safe Bayesian Optimization

  • scikit-optimize - Sequential model-based optimization with a scipy.optimize
    interface

  • Solid - A comprehensive gradient-free optimization framework written in Python

  • PySwarms - A research toolkit for particle swarm optimization in Python

  • Platypus - A Free and Open Source Python Library for Multiobjective Optimization

  • GPflowOpt - Bayesian Optimization using GPflow

  • POT - Python Optimal Transport library

  • Talos - Hyperparameter Optimization for Keras Models

Natural Language Processing

  • NLTK - modules, data sets, and tutorials supporting research and development in Natural Language Processing

  • CLTK - The Classical Language Toolkik

  • gensim - Topic Modelling for Humans

  • PSI-Toolkit - a natural language processing toolkit by Adam Mickiewicz University in Poznań

  • pyMorfologik - Python binding for Morfologik (Polish morphological analyzer)

  • skift - scikit-learn wrappers for Python fastText.

  • Phonemizer - Simple text to phonemes converter for multiple languages

Computer Audition

  • librosa - Python library for audio and music analysis

  • Yaafe - Audio features extraction

  • aubio - a library for audio and music analysis

  • Essentia - library for audio and music analysis, description and synthesis

  • LibXtract - is a simple, portable, lightweight library of audio feature extraction functions

  • Marsyas - Music Analysis, Retrieval and Synthesis for Audio Signals

  • muda - a library for augmenting annotated audio data

  • madmom - Python audio and music signal processing library

Computer Vision

  • OpenCV - Open Source Computer Vision Library

  • scikit-image - Image Processing SciKit (Toolbox for SciPy)

  • imgaug - image augmentation for machine learning experiments

  • imgaug_extension - additional augmentations for imgaug

  • Augmentor - Image augmentation library in Python for machine learning

  • albumentations - fast image augmentation library and easy to use wrapper around other libraries

Feature engineering

  • Featuretools - automated feature engineering

  • scikit-feature - feature selection repository in python

  • skl-groups - scikit-learn addon to operate on set/”group”-based features

  • Feature Forge - a set of tools for creating and testing machine learning feature

  • boruta_py - implementations of the Boruta all-relevant feature selection method

  • BoostARoota - a fast xgboost feature selection algorithm

  • few - a feature engineering wrapper for sklearn

  • scikit-rebate - a scikit-learn-compatible Python implementation of ReBATE, a suite of Relief-based feature selection algorithms for Machine Learning

  • scikit-mdr - a sklearn-compatible Python implementation of Multifactor Dimensionality Reduction (MDR) for feature construction.

  • tsfresh - Automatic extraction of relevant features from time series

Data manipulation & pipelines

  • pandas - powerful Python data analysis toolkit

  • sklearn-pandas - Pandas integration with sklearn

  • alexander - wrapper that aims to make scikit-learn fully compatible with pandas

  • blaze - NumPy and Pandas interface to Big Data

  • pandasql - allows you to query pandas DataFrames using SQL syntax

  • pandas-gbq - Pandas Google Big Query

  • xpandas - universal 1d/2d data containers with Transformers functionality for data analysis by The Alan Turing Institute

  • Fuel - data pipeline framework for machine learning

  • Arctic - high performance datastore for time series and tick data

  • pdpipe - sasy pipelines for pandas DataFrames.

  • SSPipe - Python pipe () operator with support for DataFrames and Numpy and Pytorch

  • meza - a Python toolkit for processing tabular data

  • pandas-ply - functional data manipulation for pandas

  • Dplython - Dplyr for Python

  • pysparkling - a pure Python implementation of Apache Spark’s RDD and DStream interfaces

  • quinn - pyspark methods to enhance developer productivity

  • Dataset - helps you conveniently work with random or sequential batches of your data and define data processing

  • swifter - a package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

Statistics

  • statsmodels - statistical modeling and econometrics in Python

  • stockstats - Supply a wrapper StockDataFrame
    based on the pandas.DataFrame
    with inline stock statistics/indicators support.

  • simplestatistics - simple statistical functions implemented in readable Python.

  • weightedcalcs - pandas-based utility to calculate weighted means, medians, distributions, standard deviations, and more

  • scikit-posthocs - Pairwise Multiple Comparisons Post-hoc Tests

  • pysie - provides python implementation of statistical inference engine

Experiments tools

  • Sacred - a tool to help you configure, organize, log and reproduce experiments by IDSIA

  • Xcessiv - a web-based application for quick, scalable, and automated hyperparameter tuning and stacked ensembling

  • Persimmon - A visual dataflow programming language for sklearn

Visualization

  • Matplotlib - plotting with Python

  • seaborn - statistical data visualization using matplotlib

  • Bokeh - Interactive Web Plotting for Python

  • HoloViews - stop plotting your data - annotate your data and let it visualize itself

  • Alphalens - performance analysis of predictive (alpha) stock factors by Quantopian

  • python-ternary - ternary plotting library for python with matplotlib

  • Naarad - framework for performance analysis & rating of sharded & stateful services.

Evaluation

Computations

  • numpy - the fundamental package needed for scientific computing with Python.

  • Dask - parallel computing with task scheduling

  • bottleneck - Fast NumPy array functions written in C

  • minpy - NumPy interface with mixed backend execution

  • CuPy - NumPy-like API accelerated with CUDA

  • scikit-tensor - Python library for multilinear algebra and tensor factorizations

  • numdifftools - solve automatic numerical differentiation problems in one or more variables

  • quaternion - Add built-in support for quaternions to numpy

  • adaptive - Tools for adaptive and parallel samping of mathematical functions

Spatial analysis

  • GeoPandas - Python tools for geographic data

  • PySal - Python Spatial Analysis Library

Quantum Computing

  • QML - a Python Toolkit for Quantum Machine Learning

Conversion

  • sklearn-porter - transpile trained scikit-learn estimators to C, Java, JavaScript and others

  • ONNX - Open Neural Network Exchange

  • MMdnn - a set of tools to help users inter-operate among different deep learning frameworks.

See Also


r/MLNotes • • Sep 08 '21

Introduction to Machine Learning Interviews Book · MLIB

Thumbnail huyenchip.com
4 Upvotes

r/MLNotes • • Nov 05 '19

[InterpretableAI] Notes on interpretability: Paper List

4 Upvotes

Source

Overviews

Molnar. Interpretable machine learning. A Guide for Making Black Box Models Explainable. 2019.

Miller. Explanation in Artificial Intelligence: Insights from the Social Sciences. In AIJ 2018.

Murdoch et al. Interpretable machine learning: definitions, methods, and applications. arxiv 2019.

Barredo Arrieta et al. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. arxiv 2019.

Guidotti et al. A Survey Of Methods For Explaining Black Box Models. arxiv 2018.

Ras et al. Explanation Methods in Deep Learning: Users, Values, Concerns and Challenges . arxiv 2018.

Gilpin et al. Explaining Explanations: An Overview of Interpretability of Machine Learning. In DSAA 2018.

Perspectives

Kleinberg and Mullainathan. Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability. video. In ACM EC 2019.

Ribera and Lapedriza. Can we do better explanations? A proposal of User-Centered Explainable AI. In *FAT 2019.

Lage et al. An Evaluation of the Human-Interpretability of Explanation. arxiv 2019.

Yang et al. Evaluating Explanation Without Ground Truth in Interpretable Machine Learning. arxiv 2019.

  • This paper defines the problem od evaluating explanations and systematically reviews the existing efforts.

  • The authors summarize three general aspects of explanation: predictability, fidelity, and persuasibility.

Rudin. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. In Nature 2019.

Tomsett et al. Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systems. In WHI 2018.

Poursabzi-Sangdeh et al. Manipulating and Measuring Model Interpretability. arxiv 2018.

  • This paper found no significant difference in multiple measures of trust when manipulating interpretability.

  • Increased transparency hampered people's ability to detect when a model had made a sizeable mistake.

Building interpretable machine learning models is not a purely computational model [...] what is or is not "interpretable" is defined by people, not algorithms.

Preece et al. Stakeholders in Explainable AI. In AAAI 2018 Fall Symposium Series.

Doshi-Velez and Kim. Towards A Rigorous Science of Interpretable Machine Learning. arxiv 2017.

Dhurandhar et al. A Formal Framework to Characterize Interpretability of Procedures. In WHI 2017.

Herman. The Promise and Peril of Human Evaluation for Model Interpretability. In NeurIPS 2017 Symposium on Interpretable Machine Learning.

  • They propose a distinction between descriptive and persuasive explanations.

Weller. Transparency: Motivations and Challenges. In WHI 2017.

Lipton. The Mythos of Model Interpretability. In WHI 2016.

  • The umbrella term "Explainable AI" encompasses at least three distinct notions: transparency, explainability, and interpretability.

Blogs

The What of Explainable AI

The How of Explainable AI: Pre-modelling Explainability

The How of Explainable AI: Explainable Modelling

The How of Explainable AI: Post-modelling Explainability

Benefits of learning with explanations

Strout et al. Do Human Rationales Improve Machine Explanations?. In ACL 2019.

  • This paper shows that learning with rationales can also improve the quality of the machine's explanations as evaluated by human judges.

Ray et al. Can You Explain That? Lucid Explanations Help Human-AI Collaborative Image Retrieval. In AAAI 2019.

Selvaraju et al. Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded. In ICCV 2019.

Evaluation critera and pitfalls of explanatory methods

Camburu et al. Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanations. In NeurIPS 2019 Workshop on Safety and Robustness in Decision Making.

Heo et al. Fooling Neural Network Interpretations via Adversarial Model Manipulation. In NeurIPS 2019.

Wiegreffe and Pinter. Attention is not not Explanation. In EMNLP 2019.

  • Deteching the attention scores obtained by parts of the model degredes the model itself. A reliable adversary must also be trained.

  • Attention scores are used as poviding an explanation; not the explanation.

Serrano and Smith. Is Attention Interpretable?. In ACL 2019.

Jain and Wallace. Attention is not Explanation. In NAACL 2019.

Attention provides an important way to explain the workings of neural models. Implicit in this is the assumption that the inputs (e.g., words) accorded high attention weights are responsible for model output.

  • Attention is not strongly correlated with other, well-grounded feature-importance metrics.

  • Alternative distributions exist for which the model outputs near-identical prediction scores.

Laugel et al. Issues with post-hoc counterfactual explanations: a discussion. In HILL 2019.

Laugel et al. The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanations. In IJCAI 2019.

Aïvodji et al. Fairwashing: the risk of rationalization. In ICML 2019.

  • Fairwashing is prooting the false perception that a machine learning model respects some ethical values.

  • This paper shows that it is possible to forge a fairer explanation from a truly unfair black box trough a process that the authors coin as rationalization.

Ustun et al. Actionable Recourse in Linear Classification. IN *FAT 2019.

  • In this paper, the authors introduce recourse--the ability of a person to change the decision of the model through actionable input variables such as income vs. gender, age, or marital status.

  • Transparency and explainability do not guarantee recourse.

  • Interesting broader discussion:

    • Recourse vs. strategic manipulation.

    • Policy implications.

  • Related work:

Adebayo et al. Sanity Checks for Saliency Maps. In NeurIPS 2018.

Chandrasekaran et al. Do explanations make VQA models more predictable to a human?. In EMNLP 2018.

  • This paper measures how well a human "understands" a VQA model. The paper shows that people get better at predicting VQA model's behaviour using a few "training" examples, but that exisiting explanation modalities do not help make its failures or responses more predictable.

Jiang et al. To Trust Or Not To Trust A Classifier. In NeurIPS 2018.

Feng et al. Pathologies of Neural Models Make Interpretations Difficult. In EMNLP 2018.

  • Input reduction iteratively removes the least important word from the input.

  • The remaining words appear nonsensical to humans and are not the ones determined as important by interpretation method.

Poerner et al. Evaluating neural network explanation methods using hybrid documents and morphosyntactic agreement. In ACL 2018.

  • Important characterization of explanation:

A good explanation method should not reflect what humans attend to, but what task methods attend to.

  • Interpretability differs between small contexts NLP tasks and large context tasks.

Kindermans et al. The (Un)reliability of saliency methods. arxiv 2017.

Evaluating the reliability of saliency methods is complicated by a lack of ground truth, as ground truth would depend upon full transparency into how a model arrives at a decision---the very problem we are trying to solve for in the first place.

  • A new evaluation criterion, input invariance, requires that the saliency method mirrors the sensitivity of model with respect to transformations of the input. Input transformations that do not change network's prediction, should not change the attribution either.

Sundararajan et al. Axiomatic Attribution for Deep Networks. In ICML 2017.

  • Implementation invariance: the attributions should be identical for two functionally equivalent networks (their outputs are equal for all inputs, despite having very different implementations).

  • Sensitivity: if network assigns different predictions to two examples that differ in only one feature then the differing feature should be given a non-zero attribution.

Das et al. Human Attention in Visual Question Answering: Do Humans and Deep Networks look at the same regions?. In EMNLP 2016.

  • Current attention models in VQA do not seem to be looking at the same regions as humans.

Self-explanatory models / Model-based intepretability

Bastings et al. Interpretable Neural Predictions with Differentiable Binary Variables. In ACL 2019.

Vedantam et al. Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering. In ICML 2019.

Alvarez-Melis and Jaakkola. Towards Robust Interpretability with Self-Explaining Neural Networks. In NeurIPS 2018.

Yang et al. Commonsense Justification for Action Explanation. In EMNLP 2018.

Kim et al. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In ICML 2018.

Textual explanation generation

Ehsan et al. Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptions. in ACM IUI 2019.

Kim et al. Textual Explanations for Self-Driving Vehicles. In ECCV 2018.

Hendricks et al. Grounding Visual Explanations. In ECCV 2018.

Hendricks et al. Generating Counterfactual Explanations with Natural Language. In WHI 2018.

Hendricks et al. Generating Visual Explanations. In ECCV 2016.

Multimodal explanation generation

Wu and Mooney. Faithful Multimodal Explanation for Visual Question Answering. In ACL 2019.

Park et al. Multimodal Explanations: Justifying Decisions and Pointing to the Evidence. In CVPR 2018.

Lectures

Interpretability and Explainability in Machine Learning at Harvard University

Tutorials

Introduction to Interpretable Machine Learning by Been Kim @ MLSS 2018

GDPR

How will the GDPR impact machine learning? by Andrew Burt

Wachter et al. Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR. In Harvard Journal of Law & Technology 2018.

Wachter et al. Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation. In International Data Privacy Law 2017.

Edwards and Veale. Slave to the Algorithm? Why a 'Right to an Explanation' Is Probably Not the Remedy You Are Looking For. In 16 Duke Law & Technology Review 18 (2017).

Goodman and Flaxman. European Union regulations on algorithmic decision-making and a "right to explanation". In WHI 2016.

Applications

Bellini et al. Knowledge-aware Autoencoders for Explainable Recommender Sytems. In ACM Workshop on Deep Learning for Recommender Systems 2018.


r/MLNotes • • Jun 14 '20

[P] Warped Linear Regression Modeling

Thumbnail self.machinelearning
3 Upvotes

r/MLNotes • • Mar 28 '20

Everybody Can Make DeepFakes Now!

Thumbnail
youtube.com
3 Upvotes

r/MLNotes • • Feb 07 '20

[PyTorch] Introducing PyTorch3D: An open-source library for 3D deep learning

Thumbnail
ai.facebook.com
3 Upvotes

r/MLNotes • • Sep 16 '19

Most Research in Deep Learning is a Total Waste of Time - Jeremy Howard ...

Thumbnail
youtube.com
3 Upvotes

r/MLNotes • • Sep 12 '19

Torchvision 0.4 with Support for Video: A Quick Introduction by Francisco Massa

Thumbnail
youtube.com
3 Upvotes

r/MLNotes • • Jun 19 '19

[N] There are many platforms to manage your ML models and experiments. We just open sourced ours.

Thumbnail
self.machinelearning
3 Upvotes

r/MLNotes • • Feb 26 '21

Show HN: I wrote a book about using data science to solve “everyday” problems

Thumbnail news.ycombinator.com
2 Upvotes

r/MLNotes • • Oct 16 '20

[AL] Active Learning: Curious AI Algorithms

Thumbnail
datacamp.com
2 Upvotes

r/MLNotes • • Sep 09 '20

[Interpretability] Shapley Values

Thumbnail
christophm.github.io
2 Upvotes

r/MLNotes • • Aug 21 '20

[Python] Best hidden feature of Python | Chaining comparison operators

Thumbnail
youtube.com
2 Upvotes

r/MLNotes • • Aug 02 '20

[Training] 37 Reasons why your Neural Network is not working.

Thumbnail
blog.slavv.com
2 Upvotes

r/MLNotes • • Jun 09 '20

[Podcast] Harry Cliff: Particle Physics and the Large Hadron Collider | AI Podcast #92 with Lex Fridman

Thumbnail
youtube.com
2 Upvotes

r/MLNotes • • Jun 05 '20

ELI5: Bayesian Optimization

Thumbnail self.explainlikeimfive
2 Upvotes

r/MLNotes • • Jun 04 '20

[R] Backpropagation and the brain

Thumbnail self.machinelearning
2 Upvotes

r/MLNotes • • Jun 02 '20

[Understanding] the Bias-Variance Tradeoff

Thumbnail
scott.fortmann-roe.com
2 Upvotes

r/MLNotes • • May 05 '20

[Subhash Kak] The Limits to Machine Consciousness

Thumbnail arxiv.org
2 Upvotes

r/MLNotes • • Feb 14 '20

What should I do when my neural network doesn't learn?

Thumbnail
stats.stackexchange.com
2 Upvotes

r/MLNotes • • Jan 25 '20

ELI5: Genetic Algorithm

Thumbnail self.explainlikeimfive
2 Upvotes

r/MLNotes • • Jan 19 '20

[GNN] CS224W: Machine Learning with Graphs

Thumbnail
web.stanford.edu
2 Upvotes

r/MLNotes • • Jan 13 '20

[Library] PyBrain

Thumbnail
pybrain.org
2 Upvotes

r/MLNotes • • Jan 07 '20

List of Free Artificial Intelligence, Machine Learning, Data Science, Deep Learning, Mathematics, Python Programming Resources

Thumbnail
marktechpost.com
2 Upvotes

r/MLNotes • • Jan 07 '20

[HC] How to Read Articles That Use Machine Learning

2 Upvotes

For medical literature.

The following are key points to remember from this Users’ Guide to the Medical Literature on how to read articles that use machine learning:

  1. In recent years, many new clinical diagnostic tools have been developed using complicated machine learning methods. Machine learning methods use mathematical operations to process input data, resulting in a prediction.

  2. Modern machine learning methods use greater numbers of mathematical operations than traditional regression techniques to better define complex relationships between risk factors and outcomes. Irrespective of how a diagnostic tool is derived, it has to be evaluated using a 3-step process of deriving, validating, and establishing the clinical effectiveness of the tool.

  3. The name machine learning is used because these methods learn from examples during a process called training. There are two commonly used machine learning schemes: supervised learning, and unsupervised learning.

  4. Machine learning–based tools should also be assessed for the type of machine learning model used and its appropriateness for the input data type and data set size.

  5. Machine learning models generally have additional prespecified settings called hyperparameters (parameters that are established before a model is trained and remain fixed through the training process), which must be tuned on a data set independent of the validation set.

  6. On the validation set, the outcome against which the model is evaluated is termed the reference standard. Furthermore, the rigor of the reference standard must be assessed, such as against a universally accepted gold standard or expert grading.

  7. Similar to how a diagnostic test can be used (in principle) for triaging, screening, or diagnostic purposes, a machine learning model, developed to perform a specific task, can be used for several purposes.

  8. Even if a machine learning model has been thoroughly validated in different studies and the logistical, technical, and regulatory hurdles have been overcome for integration into the clinical workflow, the system still requires further research to measure the system’s clinical effectiveness.

  9. Readers of studies reporting the results of machine learning systems should assess the most crucial elements of machine learning model validation, such as whether the study design over-represents model performance through inappropriate hyperparameter tuning or a poor-quality reference standard.

  10. Finally, clinical gestalt plays an important role in evaluating whether the results are believable: because one of the biggest strengths of machine learning models is consistency and the lack of fatigue, a useful check for believable machine learning results is whether an experienced expert could reproduce the claimed accuracy given an abundance of time. Results that substantially differ from what such a hypothetical expert is capable of should be scrutinized and re-validated carefully.