From external regret to average reward regret
You can read it here in PDF format. Will be added (really) like a blog post soon!!