算法无处不在 Make Algorithms Ubiquitous Hulu Architecture: Today and Tomorrow

2020-02-27 227浏览

  • 1.算法无处不在 Make Algorithms Ubiquitous HuluArchitecture:Today and Tomorrow 诸葛越 Vice President, Hulu December 8, 2017
  • 2.
  • 3.
  • 4.
  • 5.诸葛越 Vice President, Hulu 工作经历 •  Hulu全球副总裁，北京研发中心总经理 •  Landscape Mobile联合创始人，CEO •  雅虎北京全球研发中心产品总监 •  微软北京研发中心资深项目经理 •  Senior Data Architect, Yahoo US 教育背景 •  PhD, MS Stanford University Computer Science •  MS Stony Brook University Applied Math •  清华大学计算机科学与技术系
  • 6.•  Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 •  ML Algorithms in Hulu –无处不在的机器学习算法在Hulu •  Democratize ML In Hulu – Hulu ML算法案例研究 •  AI Platform In Hulu – Hulu人工智能平台 •  Future Opportunities – 展望未来
  • 7.Background – 行业背景 AI is everywhere ML centric business face recognition self-driving car medical image analysis … ? consumer business online entertainment online game travel / tourist application e-commerce …
  • 8.ML Algorithm – 机器学习算法的技术定义 Program vs Algorithm vs a collection of instructions the logic to solve a class of problems Machine Learning Algorithm the method to learn the logic DATA + MODEL
  • 9.Trend – ML算法应用的趋势 targeting recommendation prediction specific scenarios 特定场景 垂直 => 水平 特型 => 通用 专家 => 平民化 ubiquitous 无处不在
  • 10.•  Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 •  ML Algorithms in Hulu –无处不在的机器学习算法在Hulu •  Democratize ML In Hulu – Hulu ML算法案例研究 •  AI Platform In Hulu – Hulu人工智能平台 •  Future Opportunities – 展望未来
  • 11.Hulu The Premier Digital Video Company Best Quality Content Video-On-Demand and Live Broadcasting
  • 12.ML Algorithms in Hulu ML算法在Hulu的应用 Viewers! Advertising! Content!
  • 13.Algorithms for Viewers 面向用户的算法 cover story smart start recommendation reason layout management
  • 14.Algorithms for Viewers 面向用户的算法 onboarding cold start convert-to-pay … Home Page cover story smart start recommendation reason layout management … ads auto-play QoS to QoE …
  • 15.Algorithms for Content and Advertising 面向内容和广告的算法 Content Advertising content valuation video understanding content based video encoding … rich targeting inventory prediction …
  • 16.•  Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 •  ML Algorithms in Hulu –无处不在的机器学习算法在Hulu •  Democratize ML In Hulu – Hulu ML 算法案例研究 •  垂直 – Reco •  水平 – Video Content Understanding •  水平到垂直 – Contextual + Ads •  AI Platform In Hulu – Hulu人工智能平台 •  Future Opportunities – 展望未来
  • 17.Recommendations:StoreShelf •  Item-based Collaborative Filtering •  Matrix Factorization •  Deep Neural Network
  • 18.DNN-based Relevance Algorithm
  • 19.Auto-Play, Time Series Model Search Watch Search Browse New Show? Browse Try it out Browse Watch Binge Watch Browse Watch Search Watch Watch Watch Watch Watch Watch Watch Recurrent Neural Network Timeline
  • 20.Video ContentUnderstanding:From Inside 从内部理解视频内容 Video derived meta-data 元数据抽取和发现 Breaks •  Ads break, end credit, ... Arts •  Video summary, ... Ceremonyҁ0.91҂ Wedding ҁ0.82҂ Brideҁ0.72҂ Eventҁ0.38҂ Groomҁ0.36҂ Womanҁ0.31҂ Mealҁ0.28҂ Marriageҁ0.27҂ Dressҁ0.25҂ Wedding receptionҁ0.18҂ Objects •  Actor, car, animal, ... Events •  Cooking, wedding, …
  • 21.Video ContentUnderstanding:From Inside 从内部理解视频内容 Live Channel Thumbnail Preview 直播频道预览
  • 22.ContextualAds:视频和广告的结合 Ads Provider Hulu Content •  Deliver semantic related or visual similar ads to viewers during playback Labels of Target Scenes Scene-Level Auto-Tagging •  视觉连贯的广告 Matching •  语义相关的广告 •  Use video derived data to match ads and contentPairs Ads Deliveryscore:0.86
  • 23.ContextualAds:视频和广告的结合 •  视觉连贯的广告 •  语义相关的广告
  • 24.ContextualAds:视频和广告的结合 •  视觉连贯的广告 •  语义相关的广告
  • 25.•  Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 •  ML Algorithms in Hulu –无处不在的机器学习算法在Hulu •  Democratize ML In Hulu – Hulu ML算法案例研究 •  AI Platform In Hulu – Hulu人工智能平台 •  Future Opportunities – 展望未来
  • 26.AI Platform – 人工智能平台 Application Model Feature Data Infrastructure All ML Applications Application Specific ML Models Shared ML Models Shared Features User Data Static / Dynamic Content Data Audio / Video / Text, Metadata Ads Data Audio / Video / Text Network / DevOps / Big Data GPU Cluster Frame Storage
  • 27.AI Platform – 人工智能平台 Application Onboarding Convert-to-Pay Cold Start Auto-Play Recommendation Content Valuation QoS to QoE Ad Targeting …… Model Application Specific ML Models User Conversion Model User Engagement Model Image Understanding …… Feature Data Infrastructure User Persona User Embedding Knowledge Graph Content Segments Content Embedding User Data Static / Dynamic Content Data Audio / Video / Text, Metadata Ads Data Audio / Video / Text Network / DevOps / Big Data GPU Cluster Frame Storage
  • 28.Computational Mode – 计算模式 model Offline ~days/hours Nearline ~minutes data Online ~milliseconds
  • 29.•  Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 •  ML Algorithms in Hulu –无处不在的机器学习算法在Hulu •  Democratize ML In Hulu – Hulu ML算法案例研究 •  Hulu AI Platform – Hulu人工智能平台 •  Future Opportunities – 展望未来
  • 30.Future Opportunities – 展望未来 •  Smarter interactions 更有创意的交互体验 •  Live Video 实时的个性化体验 •  Personalized design 个性化设计
  • 31.