The YouTube Video Recommendation System
๐ŸŽž๏ธ

The YouTube Video Recommendation System

Created
Feb 26, 2022
Editor
Tags
Recommendation System
cleanUrl: "paper/YouTubeRecommendation1"
๐Ÿ“„
๋…ผ๋ฌธ : The YouTube Video Recommendation System ์ €์ž : James Davidson, Edouard Grave, Junning Liu, Palash Nandy, Taylor Van Vleet

Introduction

์ด ๋…ผ๋ฌธ์€ YouTube ์ถ”์ฒœ์‹œ์Šคํ…œ ๋…ผ๋ฌธ ์‹œ๋ฆฌ์ฆˆ ์ค‘ ์ œ์ผ ์ฒ˜์Œ 2010๋…„์— ๋‚˜์˜จ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. ๊ทธ ์ดํ›„ YouTube๋Š” 2016๋…„, 2019๋…„ ์ถ”์ฒœ์‹œ์Šคํ…œ์„ ๊ด€๋ จํ•ด ๋…ผ๋ฌธ์„ ๊ณต๊ฐœํ–ˆ์Šต๋‹ˆ๋‹ค.
ย 
YouTube๋Š” ์Ÿ์•„์ง€๋Š” ์ •๋ณด ํ™˜๊ฒฝ์—์„œ ์ •๋ณด ๊ฒ€์ƒ‰ ๋ฐ ์ปจํ…์ธ  ๊ฒ€์ƒ‰์„ ์œ„ํ•œ ํ•ต์‹ฌ ๋ฐฉ๋ฒ•์œผ๋กœ ๊ฐœ์ธํ™” ์ถ”์ฒœ์‹œ์Šคํ…œ์„ ๋„์ž…ํ–ˆ์Šต๋‹ˆ๋‹ค. User์˜ ๊ณผ๊ฑฐ ํ™œ๋™์„ ๋ฐ”ํƒ•์œผ๋กœ ๊ฐœ์ธ ๋งž์ถค ๋น„๋””์˜ค set ์ œ๊ณต ๋ฐฉ์•ˆ์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.
User๋Š” ์•„๋ž˜์™€ ๊ฐ™์ด 3๊ฐ€์ง€ ๋ฐฉ๋ฒ•์œผ๋กœ YouTube๋ฅผ ์ด์šฉํ•ฉ๋‹ˆ๋‹ค.
1) ๊ฒ€์ƒ‰์ด๋‚˜ ๋‹ค๋ฅธ ๊ณณ์„ ํ†ตํ•ด ์œ ์ž…๋œ ๊ฒฝ์šฐ
2) YouTube ๊ฒ€์ƒ‰์„ ํ†ตํ•ด ํŠน์ •ํ•œ ๋น„๋””์˜ค๋ฅผ ์ฐพ๊ณ ์ž ํ•˜๋Š” ๊ฒฝ์šฐ
3) ํฅ๋ฏธ๋กœ์šด ์˜์ƒ์„ ์ฐพ์•„ ๋Œ์•„๋‹ค๋‹ˆ๋Š” ๊ฒฝ์šฐ
ย 
YouTube๊ฐ€ ์ถ”์ฒœ์‹œ์Šคํ…œ์„ ๊ตฌ์ถ•ํ•˜๋Š”๋ฐ ์žˆ์–ด ๊ฐ€์žฅ ์ฒ˜์Œ์œผ๋กœ ์ง๋ฉดํ–ˆ๋˜ ๋ฌธ์ œ๋Š” ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ์˜ ๋ถ€์žฌ์˜€์Šต๋‹ˆ๋‹ค. ์ฝ˜ํ…์ธ ์— ๋Œ€ํ•œ feedback๋„ ๋ช…ํ™•ํ•˜์ง€ ์•Š๋‹ค๋Š” ์  ๋˜ํ•œ ๋ฌธ์ œ์ ์ด ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
ย 

System Design

์ถ”์ฒœ์‹œ์Šคํ…œ์€ ํฌ๊ฒŒ Candidates์™€ Ranked Results๋กœ ๋‚˜๋ˆ„์–ด์ง‘๋‹ˆ๋‹ค. User์˜ ์‹œ์ฒญ, ๊ตฌ๋…, ์ข‹์•„์š” ๋“ฑ์„ seed๋กœ ํ•˜์—ฌ co-visitation์ด ์ผ์–ด๋‚œ ๋น„๋””์˜ค๋ฅผ ์ถ”๋ ค๋‚ด candidates๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ๊ทธ ์•ˆ์—์„œ ranking์„ ๋งค๊ธฐ๋Š” ๊ณผ์ •์„ ๊ฑฐ์น˜๊ฒŒ ๋ฉ๋‹ˆ๋‹ค.
ย 

1) Related Videos

๋น„๋””์˜ค ์—์„œ ์œ ์‚ฌํ•˜๊ฑฐ๋‚˜ ๊ด€๋ จ๋œ ๋น„๋””์˜ค ์„ธํŠธ๋กœ ๋งคํ•‘์„ ํ•˜์—ฌ ๊ตฌ์„ฑํ•˜๋Š” ๊ณผ์ •์ž…๋‹ˆ๋‹ค. ๋จผ์ € ์‚ฌ์šฉ์ž๊ฐ€ ์ฃผ์–ด์ง„ seed ๋™์˜์ƒ ๋ฅผ ์‹œ์ฒญํ•œ ํ›„ ์‹œ์ฒญํ•  ๊ฐ€๋Šฅ์„ฑ์ด ๋†’์€ ๋™์˜์ƒ์„ ์ •์˜ํ•ฉ๋‹ˆ๋‹ค.
์•„๋ž˜์˜ Related Score ์‹์˜ ๊ฒฝ์šฐ ๋งคํ•‘์„ ๊ณ„์‚ฐํ•˜๊ธฐ ์œ„ํ•ด Rule-Mining์ด๋‚˜ Co-visitation Counts๋กœ ์•Œ๋ ค์ง„ ๊ธฐ์ˆ ๋“ค์„ ์ด์šฉํ•˜์—ฌ ์ฃผ์–ด์ง„ 24์‹œ๊ฐ„ ๋™์•ˆ ๊ฐ ๋™์˜์ƒ (, )์— ๋Œ€ํ•ด ๊ณต๋™ ์‹œ์ฒญ ๋นˆ๋„๋ฅผ ๊ณ„์‚ฐํ•ฉ๋‹ˆ๋‹ค.
  • : ๊ณต๋™ ๋ฐฉ๋ฌธ ํšŸ์ˆ˜
  • , : ๊ฐ ๋™์˜์ƒ , ์— ๋Œ€ํ•œ ๋ชจ๋“  ์„ธ์…˜์˜ ์ด ๋ฐœ์ƒ ํšŸ์ˆ˜
  • : seed ๋น„๋””์˜ค์™€ ํ›„๋ณด ๋น„๋””์˜ค์˜ ์ธ๊ธฐ๋ฅผ ๊ณ ๋ คํ•œ ์ •๊ทœํ™” ํ•จ์ˆ˜๋กœ ์ „ ์„ธ๊ณ„์ ์ธ ์ธ๊ธฐ๋ฅผ ๊ณฑํ•œ ๊ฐ’
ย 
์œ„ ์‹์„ ํ†ตํ•ด ๋‚˜์˜จ ์ ์ˆ˜๋ฅผ ํ†ตํ•ด ์ˆœ์œ„๋ฅผ ๋งค๊ฒจ ์ƒ์œ„ N๊ฐœ์˜ ํ›„๋ณด ๋น„๋””์˜ค๋ฅผ ์„ ์ •ํ•˜๊ฒŒ ๋ฉ๋‹ˆ๋‹ค.
ย 

2) Generating Recommendation Candidates

YouTube๋Š” ๊ฐœ์ธ๋ณ„ ๋งž์ถค ์ถ”์ฒœ์‹œ์Šคํ…œ์„ ๋„์ž…ํ•˜๊ธฐ ์œ„ํ•ด ๊ด€๋ จ ๋น„๋””์˜ค ์—ฐ๊ด€ ๊ทœ์น™์„ User์˜ ๊ฐœ์ธ ํ™œ๋™๊ณผ ๊ฒฐํ•ฉํ•ฉ๋‹ˆ๋‹ค. User๊ฐ€ ์‹œ์ฒญํ•œ ๋น„๋””์˜ค, ์ข‹์•„์š” ๊ตฌ๋… ๋“ฑ์ด ์ด๋ฃจ์–ด์ง„ ๋น„๋””์˜ค๋“ค์„ ํฌํ•จํ•˜๊ณ  ์ด๋ฅผ seed set์ด๋ผ๊ณ  ๋ถ€๋ฆ…๋‹ˆ๋‹ค.
์ด seed set() ๊ฐ๊ฐ์˜ ๋น„๋””์˜ค()์™€ ๊ด€๋ จ๋œ ๋น„๋””์˜ค()๋ฅผ ๊ณ ๋ คํ•  ๋•Œ ๋น„๋””์˜ค ์„ธํŠธ์˜ ๊ฒฐํ•ฉ์„ ์ด๋ผ๊ณ  ํ•ฉ๋‹ˆ๋‹ค.
  • : seed set ๋น„๋””์˜ค์—์„œ n-๊ฑฐ๋ฆฌ ์ด๋‚ด์— ์žˆ๋Š” ๋น„๋””์˜ค ์„ธํŠธ
ํ•˜์ง€๋งŒ ์ด๋ ‡๊ฒŒ ๋˜๋ฉด user์˜ ๊ด€์‹ฌ๊ณผ ๋งค์šฐ ๊ฐ€๊นŒ์šด ์ปจํ…์ธ ์˜ ๊ฒฝ์šฐ ์ถ”์ฒœ๋˜์ง€๋งŒ ์ƒˆ๋กœ์šด ๋™์˜์ƒ์€ ์ถ”์ฒœ๋˜์ง€ ์•Š๋Š” ๋ฌธ์ œ๊ฐ€ ์ƒ๊น๋‹ˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด ๋„์ž…ํ•œ ๊ฒƒ์ด Transitive Closure๋ฅผ ์„ค์ •ํ•˜์—ฌ ํ›„๋ณด๊ตฐ์„ ํ™•์žฅํ•ฉ๋‹ˆ๋‹ค.
ย 
์ตœ์ข… ํ›„๋ณด๊ตฐ์€ ์•„๋ž˜ ์‹๊ณผ ๊ฐ™์ด ์ •์˜๋˜๋ฉฐ ๊ฐ ๋น„๋””์˜ค๋Š” seed set์— ์žˆ๋Š” ํ•˜๋‚˜ ์ด์ƒ์˜ ๋น„๋””์˜ค์™€ ์—ฐ๊ฒฐ๋ฉ๋‹ˆ๋‹ค.
ย 

3) Ranking

Candidiates set๋ฅผ ์ƒ์„ฑํ•˜๊ฒŒ ๋˜๋ฉด ์ด์ œ ๋น„๋””์˜ค ํ’ˆ์งˆ, ์‚ฌ์šฉ์ž ํŠน์ด์„ฑ, ๋‹ค์–‘์„ฑ์— ๋”ฐ๋ผ ์ˆœ์œ„๋ฅผ ๋งค๊น๋‹ˆ๋‹ค.
User์—๊ฒŒ ๊ณ„์† ์œ ์‚ฌํ•œ ์˜์ƒ๋งŒ ์ถ”์ฒœํ•˜๋ฉด ์•ˆ๋˜๊ธฐ ๋•Œ๋ฌธ์— ์ถ”์ฒœ ์˜์ƒ์˜ ์ˆ˜์— ์ œํ•œ์„ ๋‘๋Š” ๋ฐฉ๋ฒ•์„ ์ด์šฉํ•ด ์ถ”์ฒœํ•˜๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค.
ย 

Conclusion

YouTube ์ถ”์ฒœ์‹œ์Šคํ…œ์€ ์˜จ๋ผ์ธ A/B ํ…Œ์ŠคํŠธ์™€ CTR๋กœ ํ…Œ์ŠคํŠธํ•ด๋ณธ ๊ฒฐ๊ณผ 2๋ฐฐ๊ฐ€ ๋„˜๋Š” ํšจ์œจ์„ ๋ณด์ด๋Š” ๊ฒƒ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
notion image

Reference

The YouTube Video Recommendation System https://www.inf.unibz.it/~ricci/ISR/papers/p293-davidson.pdf
ย 

๋‹ค์Œ ๊ธ€ ์ฝ๊ธฐ

โค๏ธ
Deep Neural Networks for YouTube Recommendations