算法无处不在 Hulu当今和未来的技术架构 诸葛越

2020-03-01 172浏览

  • 1.算法无处不在 Make Algorithms Ubiquitous HuluArchitecture:Today and Tomorrow 诸葛越 Vice President, Hulu December 8, 2017
  • 2.
  • 3.
  • 4.
  • 5.诸葛越 Vice President, Hulu 工作经历 • 教育背景 Hulu全球副总裁，北京研发中心总经理 • Landscape Mobile联合创始人，CEO • 雅虎北京全球研发中心产品总监 • 微软北京研发中心资深项目经理 • Senior Data Architect, Yahoo US • PhD, MS Stanford University Computer Science • MS Stony Brook University Applied Math • 清华大学计算机科学与技术系
  • 6.• Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 • ML Algorithms in Hulu –无处不在的机器学习算法在Hulu • Democratize ML In Hulu – Hulu ML算法案例研究 • AI Platform In Hulu – Hulu人工智能平台 • Future Opportunities – 展望未来
  • 7.Background – 行业背景 AI is everywhere ? ML centric business consumer business face recognition self-driving car medical image analysis … online entertainment online game travel / tourist application e-commerce …
  • 8.ML Algorithm – 机器学习算法的技术定义 Program a collection of instructions vs Algorithm the logic to solve a class of problems vs Machine Learning Algorithm the method to learn the logic DATA + MODEL
  • 9.Trend – ML算法应用的趋势 垂直 => 水平 targeting recommendation 特型 => 通用 专家 => 平民化 prediction specific scenarios 特定场景 ubiquitous 无处不在
  • 10.• Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 • ML Algorithms in Hulu –无处不在的机器学习算法在Hulu • Democratize ML In Hulu – Hulu ML算法案例研究 • AI Platform In Hulu – Hulu人工智能平台 • Future Opportunities – 展望未来
  • 11.Hulu The Premier Digital Video Company Best Quality Content Video-On-Demand and Live Broadcasting
  • 12.ML Algorithms in Hulu ML算法在Hulu的应用 Viewers! Advertising! Content!
  • 13.Algorithms for Viewers 面向用户的算法 layout management cover story smart start recommendation reason
  • 14.Algorithms for Viewers 面向用户的算法 onboarding ads cold start auto-play convert-to-pay QoS to QoE … … Home Page cover story smart start recommendation reason layout management …
  • 15.Algorithms for Content and Advertising 面向内容和广告的算法 Content content valuation video understanding content based video encoding … Advertising rich targeting inventory prediction …
  • 16.• Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 • ML Algorithms in Hulu –无处不在的机器学习算法在Hulu • Democratize ML In Hulu – Hulu ML 算法案例研究 • • • 垂直 – Reco 水平 – Video Content Understanding 水平到垂直 – Contextual + Ads • AI Platform In Hulu – Hulu人工智能平台 • Future Opportunities – 展望未来
  • 17.Recommendations:StoreShelf • Item-based Collaborative Filtering • Matrix Factorization • Deep Neural Network
  • 18.DNN-based Relevance Algorithm
  • 19.Auto-Play, Time Series Model Search Watch New Show? Search Browse Browse Recurrent Neural Network Browse Try it out Binge Watch Watch Watch Watch Watch Browse Watch Search Watch Watch Watch Watch Timeline
  • 20.Video ContentUnderstanding:From Inside 从内部理解视频内容 Video derived meta-data 元数据抽取和发现 Breaks Arts Objects Events • Ads break, end credit, ... • Video summary, ... • Actor, car, animal, ... • Cooking, wedding, … Ceremony 0.91 Wedding 0.82 Bride 0.72 Event 0.38 Groom 0.36 Woman 0.31 Meal 0.28 Marriage 0.27 Dress 0.25 Wedding reception 0.18
  • 21.Video ContentUnderstanding:From Inside 从内部理解视频内容 Live Channel Thumbnail Preview 直播频道预览
  • 22.ContextualAds:视频和广告的结合 Ads Provider Hulu Content Labels of Target Scenes Scene-Level Auto-Tagging • Deliver semantic related or visual similar ads to viewers during playback • 视觉连贯的广告 Matching • 语义相关的广告Pairs • Use video derived data to match ads and contentscore:0.86Ads Delivery
  • 23.ContextualAds:视频和广告的结合 • 视觉连贯的广告 • 语义相关的广告
  • 24.ContextualAds:视频和广告的结合 • 视觉连贯的广告 • 语义相关的广告
  • 25.• Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 • ML Algorithms in Hulu –无处不在的机器学习算法在Hulu • Democratize ML In Hulu – Hulu ML算法案例研究 • AI Platform In Hulu – Hulu人工智能平台 • Future Opportunities – 展望未来
  • 26.AI Platform – 人工智能平台 Application All ML Applications Application Specific ML Models Model Shared ML Models Feature Data Infrastructure Shared Features User Data Static / Dynamic Content Data Audio / Video / Text, Metadata Network / DevOps / Big Data GPU Cluster Ads Data Audio / Video / Text Frame Storage
  • 27.AI Platform – 人工智能平台 Onboarding Application Convert-to-Pay Cold Start Auto-Play Recommendation User Conversion Model Data Infrastructure QoS to QoE Ad Targeting …… Application Specific ML Models Model Feature Content Valuation User Persona User Engagement Model User Embedding Image Understanding Content Segments Knowledge Graph User Data Static / Dynamic Network / DevOps / Big Data Content Data Audio / Video / Text, Metadata GPU Cluster …… Content Embedding Ads Data Audio / Video / Text Frame Storage
  • 28.Computational Mode – 计算模式 model Offline ~days/hours Nearline ~minutes data Online ~milliseconds
  • 29.• Machine Learning Algorithms in Industry – 机器学习算法企业应用场景 • ML Algorithms in Hulu –无处不在的机器学习算法在Hulu • Democratize ML In Hulu – Hulu ML算法案例研究 • Hulu AI Platform – Hulu人工智能平台 • Future Opportunities – 展望未来
  • 30.Future Opportunities – 展望未来 • Smarter interactions 更有创意的交互体验 • Live Video 实时的个性化体验 • Personalized design 个性化设计
  • 31.