Using Artificial Intelligence to Augment Human Intelligence
By creating user interfaces which let us work with the representations inside machine learning models, we can give people new tools for reasoning.
By creating user interfaces which let us work with the representations inside machine learning models, we can give people new tools for reasoning.

Provalis Research is holding a two-day training workshop for QDA Miner 5 and WordStat 7 in Ottawa, Ontario, Canada. The training will be held from February 20 to February 21, 2018 at Carleton University, Dunton Tower, Room 701. QDA Miner training: February 20 – 9am to 5pm WordStat training: February 21 – 9am to 5pm Click here for a detailed description of the […]
A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems.
A statement I commonly hear in tech-utopian circles is that some seeming inefficiency can’t actually be inefficient because the market is efficient and inefficiencies will quickly be eliminated. A contentious example of this is the claim that companies can’t be discriminating because the market is too competitive to tolerate discrimination . A less contentious example is that when you see a big company doing something that seems bizarrely ineffic
It's common knowledge that Android device tend to be more out of date than iOS devices, but what does this actually mean? Let’s look at android marketshare data to see how old devices in the wild are. The x axis of the plot below is date, and the y axis is Android marketshare. The share of all devices sums to 100% (with some artifacts because the public data Google provides is low precision). Color indicates age: blue: current (API major version) yellow: 6 months<
About once a month, an app that I regularly use will change its UI in a way that breaks muscle memory, basically tricking the user into doing things they don’t want. Zulip In recent memory, Zulip (a slack competitor) changed its newline behavior so that ctrl + enter sends a message instead of inserting a new line. After this change, I sent a number of half-baked messages and it seemed like some other people did too. Around the time they made that
We’re going to reproduce some results from papers on filesystem robustness that were written up roughly a decade ago : Prabhakaran et al. SOSP 05 paper , which injected errors below the filesystem and Gunawi et al. FAST 08 , which looked at how often filesystems failed to ch
If you look at “gaming" keyboards, a lot of them sell for $100 or more on the promise that they’re fast. Ad copy that you’ll see includes: a custom designed keycap that has been made shorter to reduce the time it takes for your actions to register 8x FASTER - Polling Rate of 1000Hz: Response time 0.1 milliseconds Wield the ultimate performance advantage over your opponents with light operation 45g key switches and an actuation 40% faster than standard Cherry MX
Montreal, Canada’s second largest city, known for its European flair, its culinary prowess, and its many festivals, is also home to Provalis Research. We are very proud of our city, and one of the things that makes us proudest is the tech scene. Major players are converging on Montreal because of its burgeoning AI scene. […]
Tomorrow (10/10) is our eagerly anticipated first talk of the year, Philosophy of The Mind: I Think Therefore I Am? There will be two amazing speakers for this session: – Prof. Mark Mon-Williams will talk about the Philosophy of the Mind from a psychological point of view. – And Marc Cole will give us the philosophical point of view. After the talks, we’ll be going …

Welcome back to Leeds for another academic year! It was good to see so many of you sign up and show interest in our society at the freshers fair last week from all difference subject areas. For those who don’t know, we’re an academic neuroscience society aimed at spreading current findings from neuroscience. We aim to run talks, debates, trips to BNA conferences throughout the …
On October 19 2017, Ubuntu 17.10 will be released and as many of you know it packs lots of significant changes. I spend a week testing the Beta 2 and in this “last minute” review, I document some of the less obvious features/gotchas of Ubuntu 17.10. I also share with you my experience and provide […]
Provalis Research is holding a three-day training workshop for QDA Miner 5 and WordStat 7 in Montreal, Quebec, Canada. The training will be held from December 6 to December 8, 2017 at the Provalis Research head office. QDA Miner training: December 6 and December 7 – 9am to 5pm, 9am to 12pm WordStat training: December 7 and December […]

The Datumbox v0.8.1 has been released! Download it now from Github or Maven Central Repository. What is new? The main focus of version 0.8.1 is to resolve various bugs, update the depedencies and improve the code architecture of the framework. Here are the details: Dependencies: Updated the Maven Compiler, Nexus Staging, Surefire, SLF4J and Logback […]
This is a pseudo-transcript for a talk on branch prediction given at Two Sigma on 8/22/2017 to kick off "localhost", a talk series organized by RC . How many of you use branches in your code? Could you please raise your hand if you use if statements or pattern matching? Most of the audience raises their hands I won’t ask you to raise your hands for this next part, but
Although relatively simple, Naïve Bayes (NB) is one of the powerful machine learning techniques. It’s not only simple but fast and accurate and has been used in various applications and domains. So, it’s a reliable friend that you can trust on rainy days! In this post, we will see how it works. Who is NB’s […]

I recently had a problem where part of the solution was to do a series of pointer accesses that would walk around a chunk of memory in pseudo-random order. Sattolo's algorithm provides a solution to this because it produces a permutation of a list with exactly one cycle, which guarantees that we will reach every element of the list even though we're traversing it in random order. However, the explanations of why the algorithm worked that I could find online either used some kind of mat
In our previous post on machine learning, we explained that there are supervised and unsupervised beasts lurking in machine learning land! One of the simplest machine learning techniques is the K-nearest neighbors (KNN). In this post, we will briefly review the way KNN works. We’ve all heard of lazy guys! With technology being more accessible […]

As more data becomes available, it gets harder to find and discover what to look for! As we discussed in our previous post topic modeling is a powerful unsupervised machine learning technique to discover hidden themes in a collection of documents. Topic modeling has achieved popularity in different disciplines because it offers several meaningful […]

There’s a great MSR demo from 2012 that shows the effect of latency on the experience of using a tablet . If you don’t want to watch the three minute video, they basically created a device which could simulate arbitrary latencies down to a fraction of a millisecond. At 100ms (1/10th of a second), which is typical of consumer tablets, the experience is terrible. At 10ms (1/100th of a second), the latency is noticeable, but the experience
John Ford is a public sector Research Psychologist who has authored numerous reports and articles about assessment, training, and other personnel management issues. He wrote this guest blog about a recent challenge of how to deal more efficiently with out of office messages with respect to tabulating the survey response rate. In this blog he […]
Throughout history, we have been interested in seeing the future, either in the form of checking the arrival time of the prince on a white horse or predicting stock prices to get rich! What caused this curse?! It’s probably part of human nature but we can also trace fortune-telling back to the advent of astrology, […]
Many believe robotics is on the cusp of becoming the next technological revolution and that we should expect a significant impact from “intelligent” robots in the near future. Even today, we can see robots and intelligent systems working here and there in different domains. But, robotics is only one application of machine learning and artificial […]

We saw earlier that although machines are stone-hearted, they can learn! As a subset of artificial intelligence (AI), machine learning algorithms enable computers to learn from data, and even improve themselves, without being explicitly programmed. That’s how your Siri communicates with you, or how your super car parks itself, or, partially, how your bank approves […]
Which is faster, keyboard or mouse? A large number of programmers believe that the keyboard is faster for all (programming-related) tasks. However, there are a few widely cited webpages on AskTog which claim that Apple studies show that using the mouse is faster than using the keyboard for everything and that people who think that using the keyboard is faster are just deluding themselves. This might sound extreme, but, just for example, one page says that the author has “never seen [the keybo
I often talk to startups that claim that their compensation package has a higher expected value than the equivalent package at a place like Facebook, Google, Twitter, or Snapchat. One thing I don’t understand about this claim is, if the claim is true, why shouldn’t the startup go to an investor, sell their options for what they claim their options to be worth, and then pay me in cash? The non-obvious value of options combined with their volatility is a barrier for recruiting. Additiona
Provalis Research is holding a three-day training workshop for QDA Miner 5 and WordStat 7 in Montreal, Quebec, Canada. The training will be held from August 16th to August 18, 2017 at the Provalis Research head office. It is also possible to register for a 2 day QDA Miner workshop only. However, when the number of participants […]
The ALS algorithm introduced by Hu et al., is a very popular technique used in Recommender System problems, especially when we have implicit datasets (for example clicks, likes etc). It can handle large volumes of data reasonably well and we can find many good implementations in various Machine Learning frameworks. Spark includes the algorithm in […]

The dstat is an awesome little tool which allows you to get resource statistics for your Linux box. It has a modular architecture which allows you to develop additional plugins and it’s easy to use. Recently I was profiling a Deep Learning pipeline developed with Keras and Tensorflow and I needed detailed statistics about the […]
A couple years ago, I took a road trip from Wisconsin to Washington and mostly stayed in rural hotels on the way. I expected the internet in rural areas too sparse to have cable internet to be slow, but I was still surprised that a large fraction of the web was inaccessible. Some blogs with lightweight styling were readable, as were pages by academics who hadn’t updated the styling on their website since 1995. But very few commercial websites were usable (other than Google). When I measured m


Datumbox Framework v0.8.0 is out and packs several powerful features! This version brings new Preprocessing, Feature Selection and Model Selection algorithms, new powerful Storage Engines that give better control on how the Models and the Dataframes are saved/loaded, several pre-trained Machine Learning models and lots of memory & speed improvements. Download it now from Github […]
Several interactive visualizations of a generative model of handwriting. Some are fun, some are serious.