Thursday, June 13, 2013

Episode 28: Applied Artificial Intelligence


Download

Feedback
  • 107 Reviews on iTunes
  • America's Test Kitchen
  • Picking a Programming Language
Tool of the Show
Book of the Show

Applied Artificial Intelligence

Common Terms
  • Objective Function
  • Features
  • Under/Over Fitting
  • Classification / Regression / Control
Methods
  • Supervised (Learn a function from residuals)
    • Gradient-Descent
    • Perceptron
    • Back-Propagation (Non-Linear)
  • Reinforcement Learning (Estimating value from reward)
    • Minimax, Monte Carlo Tree Search (MCTS)
    • Temporal Difference Learning
    • Genetic Algorithms
    • NEAT
  • Unsupervised (Clustering & Dimensionality Reduction)
    • K-Means
    • PCA
    • Neural Gas
Challenges
  • Making an objective function
  • Training-Serving Skew
  • Modeling
    • Linearizing
    • Feature-Extraction & Discretization
    • Kernels
  • Measuring Performance

Friday, May 31, 2013

Episode 27: Artificial Intelligence Theory


Download

News
Tool of the Show
Book of the Show


Theoretical Artificial Intelligence

History
  • The Turk 1770
  • Turing Test, Three Laws of Robotics(1942)
  • First neural net: 1951
  • Arthur Samuel’s Checkers AI: ‘51
  • Golden Age (‘56 - ‘74)
  • AI Winter (74-80)
  • Renaissance (1990+)
  • Deep Blue vs kasparov 1996
What is AI?
  • "Real" Intelligence versus Artificial Intelligence
  • Common-Sense Knowledge
  • Goals: Deducting, Reasoning, Problem Solving
Challenges
  • “Strong AI” (General AI): Artificial Intelligence that meets or exceeds human intelligence at every level.
  • Combinatorial explosion in planning
  • Knowledge representation
  • The frame problem
AI Projects

Episode 25: Unit Testing


Download

News
Tool of the Show
Book of the Show


Unit Testing

History
  • 1956 “The Debugging Period”
    • Testing associated with debugging
  • 1957 - 1978 “Demonstration Period”
    • Show software satisfies requirements
  • 1979 - 1982 “Destruction Oriented Period”
    • Testing should find errors
  • 1983 - 1987 “Evaluation Oriented Period”
    • Testing to measure quality
  • 1988+ “Prevention-Oriented”
    • Detect and prevent faults
Features
  • Prove correctness
  • Mocking
  • Code Coverage (Statement  and branch)
Strengths
  • Establish a contract for the code
  • Make sure there is no unreachable code
  • Force writing testable code
  • Can serve as programmatic documentation
Weaknesses
  • Time consuming
  • Establish constraints that may not be valid
  • False sense of security
Tools
  • Java
    • JUnit
    • EasyMock, Mockito
  • C++
    • cpptest
    • gmock

Tuesday, March 26, 2013

Episode 26: Image Processing


Download

News
Tool of the Show
  • Jason: Moon Reader Pro+ (Android)
  • Patrick: Spaceteam (iOS)
Book of the Show


Image Processing

Overview
  • Image Processing: Image in -> image out
  • Image Analysis: Image in -> Measurements out
  • Image Understanding: Image in -> High level description out
Features & Methods
  • Matrices
  • Binary Images
  • Image Convolution
  • Histograms
  • Feature Vector
  • Artificial Intelligence
  • Singular Value Decomposition
  • Neural Networks
Challenges
  • Amount of Data to Process
  • Limited Bit Depth
  • Noise
  • Orientations
  • Occlusion
Tools
  • PIL
  • OpenCv
  • MatLab
  • Photoshop / Gimp

Tuesday, January 29, 2013

Episode 24: JVM Languages (Jython, Clojure, Scala)


Download

News
Tool of the Show
Book of the Show


JVM Languages (Jython, Clojure, Scala)

Strengths
  • Cross-Platform
  • Access to java libraries (especially UI)
  • Can sit on top of Hadoop
Weaknesses
  • Potentially slower
  • Require JVM tuning if memory usage is high

Wednesday, December 26, 2012

Episode 23: Hadoop


Download

News
Tool of the Show
Book of the Show


Hadoop

History
  • Jeff Dean & Sanjay Ghemawat wrote the paper MapReduce
  • Created by Doug Cutting while he was at Yahoo!.
  • Intended to support Lucene (search engine reverse indexing).
  • Facebook announces their hadoop filesystem has grown to 100 petabytes. 
Features
  • HDFS: Hadoop Distributed Filesystem
  • HBase: A distributed, column-oriented database
  • Zookeeper: Distributed coordination service
  • Crunch: Simplified API for creating mapreduce pipelines.

        Strengths
        • Scale-free
        • Fault Tolerant
        • Can add/remove hardware in real-time.
        Weaknesses
        • Long spin up / spin down time.
          • Worker Pools
        • Excessive Serialization/deserialization
        • Excessive Materialization

        Tools
        • Avro: A serialization framework
        • Pig & Hive: querying and storing large datasets

        Uses
        • Storing/Manipulating Big Data.

        Sunday, December 9, 2012

        Episode 22: LaTeX


        Download

        News
        Tool of the Show
        Book of the Show
        LaTeX

        History
        • TeX
          • Created by Donald Knuth
          • Based on 19th century typesetting machines
        • LaTeX
          • Created by Leslie Lamport
          • TeX with many macros

            Features
            • bibtex: bibliography management
              • Most citations have a .bib file for easy import
            • Decouple the content (the source) from the style
              • Turn your paper into a book, book into a webpage, etc.
            • Automatic generation of references, table of contents, bibliography
            • Export to many formats
              • dvi (default)
              • latex2html
              • pdf (using pdflatex)
              • ps
            • Not WYSIWYG, WYSIWYM

                  Tools

                  Uses
                  • Academic writing
                    • Conferences, journals
                  • Writing Textbooks
                  • Resumes, curricula vitae