Archive by Author | vadimgalaktionov

Recurrent neural networks and why you should care


“21 Of The Most Life–Changing Food Magazine Moments Of 2013”

“Why Are The Kids On The Golf Team Changing The World?”

“John McCain Warns Supreme Court To Stand Up For Birth Control Reform”


Take a look at the above headlines. At first glance, they might seem completely typical, not unlike the stories on the front pages of more clickbait-y sites like BuzzFeed or Gawker.

In fact, those aren’t real headlines: a computer algorithm has generated them. The model was trained using 2 million real headlines from websites like the ones mentioned above. After three days, it was able to output grammatically correct, vaguely real sounding headlines like these. The model achieved this through the use of so-called recurrent neural networks (RNN).

Artificial neural networks have been used in machine learning for a while. They are a simple representation of the functioning of a human brain: a network of nodes (neurons), with connections between them (synapses). Each of the neurons takes its input and transforms it to an output, while each synapse is assigned weights. This neural network is then ‘trained’ to transform the initial input to your desired output, by adjusting the weights of the synapses.

If that makes little sense, consider the above diagram: The first layer of neurons simply looks for lines, corners, or colors in the input image. The next layer interprets those to look for shapes or components, like ears or a nose. This continues through the layers, until the top neurons are able to identify the image as a cat with 90% certainty. For a more detailed explanation, feel free to visit Google’s research blog.

A recurrent neural network improves on the basic concept by also feeding its state at a past timestep into the current timestep. Essentially, this makes the model very suited for operations on sequential data, like text sentences. This is exactly what happened in the experiment above. The theoretic foundations for RNNs were laid a long time ago, but recent advances in computing hardware have made it possible to actually put them to use.

Now while computers generating headlines for blogs is cool, it doesn’t add much value. Luckily, RNNs can be applied to more useful problems as well. For example, Google relies on RNNs for natural speech recognition to power their voice assistant, Google Now. The same goes for the feature in Google Photos that allows you to search for ‘sunset’ and returns only those pictures you took with a sunset in them, and nothing else. They can be used to automatically classify movie reviews by general sentiment (very negative, neutral, positive, etc.). They can be used to predict stock prices of the S&P500. And so on.

In short, recurrent neural networks are what happens behind the scenes of many IT applications that make you go ‘Wow’.

Why is Pepsi building a phone?

Quick, name the first smartphone brands that come to mind.

Most people would mention Apple, Samsung, HTC, LG or Sony. If you’re more familiar with the industry, you might add Lenovo, Xiaomi, and/or Huawei to the above list. You’re very unlikely to mention Pepsi, however.

Yet a recent leak indicates that the beverage manufacturer will indeed release an Android phone. According to, seemingly the source of those leaks, the phone is to be called the Pepsi P1. The device will feature a 5,5-inch screen with 1080p resolution, a 1,7GHz processor and 2GB of RAM. The rest of the technical specifications include: 16GB of storage, 3000mAh of battery capacity, and a 13 megapixel main camera along with a 5 megapixel front-facing one. The phone is expected to retail for CNY 1.299 – approximately € 180. Pepsi will reportedly announce the device on October 20th, and it appears to be a China exclusive.

Pepsi is not the first unexpected company to get involved in selling smartphones: Facebook attempted it in 2013 with the HTC First, and Kodak has released the IM5 this summer. The former was a dramatic flop with only 15.000 units sold across the US. There are no sales results available for the latter but it’s not likely to have done well, with only 4 stores in the Netherlands still stocking it.

But at least Facebook and Kodak had somewhat sensible reasons to try their hand at smartphones. For Facebook, the phone was intended to promote their ill-fated Android homescreen replacement. Kodak counted on their brand recognition amongst the older crowd, targeting consumers that are shopping for their first smartphone.

Pepsi’s core business however, has nothing to do with consumer technology. It’s entirely unclear why they would enter the highly competitive Chinese smartphone market, what value they could add, or who their target customers would be. A spokesman told the Daily Mail that “Pepsi has always moved at the speed of culture, and today technology is a key cultural pillar at the heart of consumer interaction”, which doesn’t seem to actually mean anything. Do you know of a better reason for Pepsi to release a phone? Feel free to let us know in the comments.