scaling_youtube

《scaling_youtube》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、PoweredbyYouTube:ScalingYouTubeCuongDo7/10/2008AgendaHistoricalcontextScalabilityhighlightsChallengesLessonslearnedQ&AWhatisthisgraph?1.Thepriceofagallonofgas2.MyweightafterjoiningGoogle3.YouTube’sdailyvideoviewsSiteGrowthTimeline2/2005:founded10/2005:firstroundofVCfunding;fir

2、stoffice!03/2006:30millionvideoplaybacks/day07/2006:100millionvideoplaybacks/day11/2006:acquiredbyGoogle:FREEFOOD!(alreadyatop10sitebymultiplemeasures)Q32007:#4onAlexaToday:10hoursofvideouploadedperminute“hundredsofmillions”ofvideoplaybacks/dayPre-AcquisitionTeam2systemadminis

3、trators2scalabilitysoftwarearchitects2featuredevelopers2networkengineers1databaseadministrator0chefs!HandlingRapidGrowthwhile(true){identify_and_fix_bottlenecks();drink();sleep(TOO_LITTLE);notice_new_bottleneck();}Sometimeswecombineafewsteps…WebRequestFlowourmostpopularcontent

4、othercontentKeytechnologiesLinux(SuSE10.x)Apache(2.2.x)/lighttpd1.4.xMySQL5.0.xPythonfor99.999%ofapplicationcodeCextensionsforperformance-criticalcodeWebmachinesarecheaperthantalentedengineersCheetahtemplatesystem+Googletechnologies(Search,Bigtable,GFS,etc.)DatabasesScalabilit

5、yChallengesRapid,unpredictablegrowthPassionateusersNewfeaturesPushinghardwareandsoftwareboundariesPerformancebottlenecksgettingmoreobscureNoMoreVideos?From:foo@youtube.comSubject:oh@#!%.Date:October22,20052:24:33AMPDTTo:allofyoutubewecan’tacceptanymorevideos.toomanyvideos.Culp

6、rit:inodes/directoryPushingourdatabasetoitslimitsThesite,whichallowsviewerstotuneintouploadedvideosrangingfromseniorsmakingtheirhomespunvideodebuttopolisheduser-submittedfilmclips,wentdownat7:30a.m.(PST),leavingviewerswithatongue-in-cheekgraphicofthecompany'sdatabasewoes.-CNET

7、,8/15/2006Culprit:“What?Youdidn’twantthoseserversthere?”IngredientsforScalabilityKeepitsimple!Iterate,iterate,iterateSoftware:DB,caching,webservertweaksOStweaksHardware:memory,RAIDBepersistentAnd…LastIngredient:AGreatEngineeringTeamQ&A