AI News Today

A family of early-vision neurons reacting to directional transitions from high to low spatial frequency.

My ML mentees often ask me some variant of the question "how do you choose which papers to read from the deluge of publications flooding Arxiv every day?” The nice thing about reading most ML papers is that you can cut through the jargon by asking just five simple questions. I try to answer these questions as quickly a

Provalis Research in collaboration with the Mixed Methods International Research Association – Caribbean Chapter (MMIRA-CC) will give a FREE 3-hour workshop on content analysis, a powerful deductive technique for text analysis. The workshop will be held online, Friday, February 26, from 12:00 pm to 3:00 pm Eastern Time. Content analysis approach allows analysts and researchers […]

By visualizing the hidden state between a model's layers, we can get some clues as to the model's "thought process". Figure: Finding the words to say After a language model generates a sentence, we can visualize a view of how the model came by each word (column). Each row is a model layer. The value and color indicate the ranking of the output token at that layer. The darker the color, the higher the ranking. Layer 0 is at the top. Layer 47 is at the bottom. Model:GPT2-XL Part 2: Continuing the

Who is doing interesting work on decentralised content moderation? With Donald Trump suspended from Twitter and Facebook, and Parler kicked off AWS, there is renewed discussion about what sort of speech is acceptable online, and how it should be enforced. Let me say up front that I believe that these...

If you thought machine learning on mobile is already a bit of a stretch, how about machine learning on microcontrollers? Take the Arduino Uno . This has an 8-bit CPU running at 16 MHz, no real floating point support — it does not even have a division instruction — and only has 2KB of RAM. Is it even possible to do machine learning on these devices? The answer is yes , but you need to be smart about the al

With a new year upon us, we also have a new blog! In this post, we would like to take a look back at some of the highlights from 2020, as well as some ideas we have for 2021.

I’ve added a code outline tool to help you see the intermediate-level structure of a web browser. As Chris and I write more chapters, it’ll become more and more useful.

<p>Happy new year from Svelte! In the last month we made progress on Sapper's upcoming release, fine-tuned our <code>SvelteComponent</code> typings, and have seen some amazing apps, sites, and libraries coming out in the showcase.</p> <h2 id="What's-changed-in-Svelte"><span>What's changed in Svelte?</span><a href="#What's-changed-in-Svelte" class="permalink" aria-label="permalink"></a></h2><p>A new minor release replaces the <code>SvelteComponent</code> class with a <code>SvelteComponentTyped</c

In the classic 1986 essay, No Silver Bullet , Fred Brooks argued that there is, in some sense, not that much that can be done to improve programmer productivity. His line of reasoning is that programming tasks contain a core of essential/conceptual 1 complexity that's fundamentally not amenable to attack by any potential advances in technology (such

2020 has been a long year. As it comes to an end we wanted to share a special Holiday Update on our research into zero-bundle-size React Server Components.

Interfaces for exploring transformer language models by looking at input saliency and neuron activation. Explorable #1: Input saliency of a list of countries generated by a language model Tap or hover over the output tokens: Explorable #2: Neuron activation analysis reveals four groups of neurons, each is associated with generating a certain type of token Tap or hover over the sparklines on the left to isolate a certain factor: The Transformer architecture has been powering a number of the recen

Chapter 3 is ready. Read about typography, baselines, and tags! Our browser lines up text with style! My favorite aside is the Michigan Supreme Court case on font sizes.

Neural networks naturally learn many transformed copies of the same feature, connected by symmetric weights.

In the 2020 presidential election, most exit polls showed Donald Trump largely holding on to his support among white evangelicals with approximately 81% support essentially the same as in 2016 (AP VoteCast). Trump saw a drop in the white Catholic vote to Biden, who is Catholic, but gained among Catholic Hispanics. Trump held this […]

This blog post uses MathJax to render mathematics. You need JavaScript enabled for MathJax to work. In some recent research, Heidi and I needed to solve the following problem. Say you want to sync a hash graph, such as a Git repository, between two nodes. In Git, each commit is...

A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question. Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's probably important. Caring too much makes you a sheep. But you need to be at least a little in tune with others to do something useful for them. It seems like there are two degrees of freedom: you can choose the people whose

Disclaimer, these are just my opinions and not necessarily those of my employer or robotics colleagues. 2021-04-23: If you liked this post, you may be interested in a more recent blog post I wrote on why I believe in end-to-end learning for robots. Hacker

One question I get a lot is: I’m using the Vision framework to run an object detection model on iOS but the predicted bounding boxes are not being drawn in the right place . Help! This is a very common problem and it happens because there are several different coordinate systems that you have to translate between. Which means you need to do math! In this blog post I’ll explain what’s going on. <a href="

This is the video of my interview for the Formwelt Institute. It is about 40 minutes long during which time Gitta Peyn and I cover a variety of interesting topics such as: how I got called the Larry King of the Singularity; the misperception around the singularity and transhumanism; why humanity and not AI is […]

Text analytics and text mining have many uses in human resources. There is one main reason, there is a lot of text-based communication in almost every organization; employee surveys, performance reviews general employee feedback, resumes, “town hall” meetings, social media, and so on. HR departments realize that regularly analyzing and tracking this communication can improve […]

Learn different strategies for incrementally adopting Next.js into your development workflow.

With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.

Hans Moravec famously claimed that robots will be our (mind) children. If true, then, it is natural to wonder What to Expect When You’re Expecting Robots? This is the question that Laura Major and Julie Shah – two expert robot engineers, are addressing in their new book. Given the subject of robots and AI as […]

Build or buy? This is a question we run into often. Why should I buy your text mining product or something similar from one of your competitors when I can build it myself? Is there an easy answer to this question? Maybe not easy, but we think once you look at the different factors in […]

<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjAATc5pbHURIs7SiDqkHj6O3T2rYRqxzZkC7FrtxzRfJVAyz9HVrBjvZFJxfr5aPL-FXoBhynPuIgEN7qISFOBRGXCFDNPVP5gRJ1lhT_XelBDUu9834g9yVf-6PVohLqmAJlWJbet4r8/" style="clear: righ

DejaDup is the default backup application for Gnome. It’s a GUI for duplicity, focuses on simplicity, supports incremental encrypted backups and up until recently supported a large number of cloud providers. Unfortunately as of version 42.0, all major cloud providers have been removed. Thus given that Ubuntu 20.10 ships with the specific version, any user […]

Xiaoyi Yin (尹肖贻) has kindly translated this post into Chinese ( 中文 ) Accept-or-reject de

A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off the ground, the network effects are self-sustaining. More YC-like things are good for the world; I generally try to be helpful. But almost none of them work. People are right about the self-sustaining part, but they can’t

With the new qualitative content analysis functions of Provalis Research’s QDA Miner, market research firms and marketing analysts can shorten the analysis process and gain deeper client experience (CX) insights. Provalis Research, the leading provider of text analytics solutions, announces the release of version 6 of QDA Miner. The latest release of this qualitative content […]

Melanie Mitchell is the Davis Professor of Complexity at the Santa Fe Institute, and Professor of Computer Science at Portland State University. Prof. Mitchell is the author of a number of interesting books such as Complexity: A Guided Tour and Artificial Intelligence: A Guide for Thinking Humans. One interesting detail of her academic bio is […]

Why is Web Browser Engineering in Python? In short, Python is popular, readable, and has access to standard system APIs.

We all know that Covid-19 has decimated the travel industry. Most experts believe it will take years before travel returns to 2019 levels. What will it take to get there? In their paper Ugur & Akbiyik (2020) use text mining to look for some of the potential answers. The paper uses data from early in […]

For want of a nail the shoe was lost. For want of a shoe the horse was lost. For want of a horse the rider was lost. For want of a rider the message was lost. For want of a message the battle was lost. For want of a battle the kingdom was lost. </p

Examining the design of interactive articles by synthesizing theory from disciplines such as education, journalism, and visualization.

Content marketing is a strategic marketing method to develop valuable and relevant brand content to a target audience. It is not about pushing products but about relating and sharing stories to build relationships and connect with specific consumers. Content marketing has been used for years. There are many examples of specially targeted publications that were […]

Have you noticed that the byline on https://browser.engineering has changed? Chris Harrelson will be joining Web Browser Engineering as a co-author. He’s already working to make WBE deeper and more realistic based on his experience on the Chrome team.

A collection of articles and comments with the goal of understanding how to design robust and general purpose self-organizing systems.