Pervasive experimentation & visualization to hone machine learning on big data

This month we have Jeremy Stanley from Collective presenting "But does it really work? Using pervasive experimentation & visualization to hone machine learning on big data."

Abstract:

How do you know if your machine learning system works? You've tested it on a held out set of data, but is that enough? What if you have 1,000s of models in production influencing billions of... [read more]

This month we have Jeremy Stanley from Collective presenting "But does it really work? Using pervasive experimentation & visualization to hone machine learning on big data."

Abstract:

How do you know if your machine learning system works? You've tested it on a held out set of data, but is that enough? What if you have 1,000s of models in production influencing billions of decisions in a chaotic, real time environment? What if you have to convince other internal departments critical to implementation success, your CEO, your customers?

At Collective, we have found that a combination of continuous 'live' experimentation, coupled with copious visualization have been key to our successes with machine learning in practice. This talk will cover our Audience Optimization system, which impacts billions of advertising impressions monthly. We continuously optimize thousands of campaigns over hundreds of millions of users, in multiple continents, against varying performance objectives.

Specifically, the talk will focus on:

The problems Audience Optimization addresses

How the system is used in production

The process and supporting architecture

The specific algorithms used

How we experiment with & visualize (almost) everything, always

How we prove our system works (to ourselves and our clients)

How we glean insights from visualizations to improve the system

The majority of the time will be spent on the final 3 points. This presentation should be of interest to any practitioners who are seeking to implement and continuously improve a large scale production machine learning system on big data.

Bio:

Jeremy Stanley is the SVP of Product and Data Sciences at Collective (www.collective.com), a top advertising technology company. Collective uses technology and data science to intelligently connect brands to audiences with personalized experiences across display, video, mobile and connected TV. At Collective, Jeremy leads technology product development and the application of data science to optimization, research and audience products. Prior to joining Collective, Jeremy was a Senior Manager at Ernst & Young (E&Y), where he created and led a global analytics group which was responsible for improving the company's market facing operations and services through the use of data science. Jeremy's background in the practical application of machine learning spans more than 10 years, and was honed while consulting at E&Y with top consumer financial services companies.

Copy and paste a Youtube link below submit

Copy and paste a Slideshare link below submit