Index | Archives | Categories | Tags | Atom Feed | RSS Feed

Getting into Machine Learning

If you are interested in getting started with Machine Learning, the TensorFlow Playgroundcache is a good way of building some intuition.

For a first introduction to the field, I recommend Neural Networks and Deep Learningcache, followed by the Deep Learningcache book.

To dive into a specific topic quickly, the TensorFlow tutorialscache are also great, Dive into Deep Learning has a lot of detail as well.

For Reinforcement Learning specifically, the standard text is Reinforcement Learning: An Introductioncache. Dave's UCL Course on RLcache is great too (playlist of all lectures).


Reading April - June 2018

Books

The Power, Naomi Alderman. Interesting point of view on gender and power dynamics. Turned out different (better) than I expected from the beginning.

Letters to a Young Scientist, E. O. Wilson. Half very interesting advice about how to do science, half anecdotes from the life of a biologist with a speciality in ants.

How we got here, Andy Kessler. Whirlwind tour of the history of the industrial revolution, technology and how it lead to modern capital markets.

Pitch Perfect - how to say it right the first time, every time, Bill McGowan. Chock full of tips to improve the way …


Cooking Recommendation: Serious Eats

If you like cooking (or eating), I recommend Serious Eatscache. They have many great recipes that are easy to follow as well as delicious - for most of the new dishes I've tried recently, I've followed recipes from Serious Eats.

Two of my favorite dishes for a lazy day are Gyudoncache, a simple rice bowl heaped with beef and onion simmered in a mix of soy sauce, sake and dashi:

Gyudon

And Salmon Teriyakicache, another rice bowl with seared salmon on top of a bed of cucumber and avocado:

Salmon Teriyaki

Both are easy to make and absolutely delicious.

Despite the …


Reading January - March 2018

Inspired by Eli Bendersky's postcache

Books

The Obstacle is the Way, Ryan Holiday. A modern introduction to Stoicism. If you don't like the writing style, try Seneca or Marcus Aurelius.

Cicero - Selected Works, Penguin Classics. One of the greatest orators of all time, contrasting his speeches with modern politicians gives you a lot of perspective.

Lessons of History, Will & Ariel Durant. Lessons from their history research, personally I found it a bit underwhelming compared to the tittle, but it has a concise summary of many historical events.

The Master of Go, Yasunari Kawabata. An account of the last title …


AlphaGo Documentary

As some of you may have noticed, the AlphaGo documentarycache is now available on Play Moviescache and Netflixcache!

It's a great documentary and really captures the history of AlphaGo very well - every time I watch it it takes me right back to the excitement of those months! If you are interested in AI, Go, or just like documentaries in general I really recommend you give it a try.


Breaking the Rules to Improve Society

Recently, I was talking with some friends about the increasing power of technology, and how it is being applied to ever more accurately enforce laws. In just one example, facial recognition is now used in China to automatically identify and fine jaywalkerscache.

One common concern is that these technologies are easily abused for more sinister purposes - mass surveillance, identification of political dissidents, etc.

However, I think there's an even more direct danger: Too rigid enforcement of laws stops society from improving. Until 1967cache, homosexuality was punishable by imprisonment in the UK. If it had been possible to always …


AlphaGo Zero

Usually in software, version numbers tend to go up, not down. With AlphaGo Zero, we did the opposite - by taking out handcrafted human knowledge, we ended up with both a simpler and more beautiful algorithm and a stronger Go program.

We provide a full description in our paper, Mastering the game of Go without human knowledge, which you can also read online.

At the core is a self-improvement loop based on self-play and Monte Carlo Tree Search (MCTS): We start with a randomly initialized network, then use this network in the MCTS to play the first games. The network is …


AlphaGo in China

You might have heard about our recent games with AlphaGocache in China, at the Future of Go summit. No only did we play the legendary Ke Jie, but there were also two new and exciting formats: Team Go and Pair Go.

This match was also very exciting on the technical side because we had improved AlphaGo to the point where we ran it on a single machine in the Google Cloudcache - that's one tenth of the computation powercache compared to the distributed version we used in the last match!

Personally, I also really enjoyed the Pair Go …


fitbit v3

Good news! My attempts with wearing the fitbit in reverse, i.e. with the sensor at the underside of my arm, were successful:

Chart showing heart rate as measured by Polar H10 vs fitbit alta HR

This time the fitbit alta HR and the Polar H10 agreed much more closely, even during an hour of running! It also correctly detected the drop in heart rate in the middle of my run when I stopped for a bit.

So while not accurate enough for serious heart rate tracking during exercise (for that I still recommend a chest strap like the Polar H10), the fitbit is definitely good enough for 24/7 monitoring and more …


fitbit v2

As promised in the previous post, I made another attempt at getting more accurate readings from the fitbit. The good news is that wearing it tighter does seem to improve the sensor readings. The bad news is that I'm not sure if this tightness is comfortable in the long run, we'll see.

The following was recorded while grocery shopping, cooking and eating Salmon Teriyaki bowls and some reading:

Chart showing heart rate as measured by Polar H10 vs fitbit alta HR

The two peaks in heart rate correspond to me walking to and from the grocery shop. Curiously the fitbit once again exaggerated my actual pulse; this time though there was definitely no …

© Julian Schrittwieser. Built using Pelican. Theme by Giulio Fidente on github. .