Facebook.Architecture

《Facebook.Architecture》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、FacebookArchitectureAdityaAgarwalDirectorofEngineering11/22/2008Agenda1ArchitectureOverview2PHP,MySQL,Memcache3Thrift,Scribe,Tools4NewsFeedArchitectureAtaGlanceTheSocialGraph120M+activeusers50B+PVspermonth10B+Photos1B+connections50K+PlatformApps400K+AppDevelopersGeneralDesignPri

2、nciples▪Useopensourcewherepossible▪Exploremakingoptimizationswhereneeded▪UnixPhilosophy▪Keepindividualcomponentssimpleyetperformant▪Combineasnecessary▪Concentrateoncleaninterfacepoints▪Buildeverythingforscale▪Trytominimizefailurepoints▪Simplicity,Simplicity,Simplicity!Architectu

3、reOverviewLAMP+ServicesPHPAdServerSearchMemcacheNetworkSelectorNewsFeedMySQLBlogfeedsCSSParserphp!MobileShareScraper!phpThriftScribeODSToolsPHP▪Goodwebprogramminglanguage▪Extensivelibrarysupportforwebdevelopment▪Activedevelopercommunity▪Goodforrapiditeration▪Dynamicallytyped,int

4、erpretedscriptinglanguagePHP:WhatweLearnt▪Toughtoscaleforlargecodebases▪Weaktyping▪Limitedopportunitiesforstaticanalysis,codeoptimizations▪Notnecessarilyoptimizedforlargewebsiteusecase▪E.g.Nodynamicreloadingoffilesonwebserver▪Linearlyincreasingcostperincludedfile▪Extensionframew

5、orkisdifficulttousePHP:Customizations▪Op-codeoptimization▪APCimprovements▪Lazyloading▪Cachepriming▪Moreefficientlockingsemanticsforvariablecachedata▪Customextensions▪Memcacheclientextension▪Serializationformat▪Logging,Statscollection,Monitoring▪Asynchronousevent-handlingmechanis

6、mMySQL▪Fast,reliable▪Usedprimarilyasstore▪Datarandomlydistributedamongstlargesetoflogicalinstances▪Mostdataaccessbasedonglobalid▪Largenumberoflogicalinstancesspreadoutacrossphysicalnodes▪Loadbalancingatphysicalnodelevel▪NoreadreplicationMySQL:WhatWeLearnt(ing)▪Logical

7、migrationofdataisverydifficult▪Createalargenumberoflogicaldbs,loadbalancethemovervaryingnumberofphysicalnodes▪Nojoinsinproduction▪Logicallydifficult(becausedataisdistributedrandomly)▪EasiertoscaleCPUonwebtierMySQL:WhatweLearnt(ing)▪Mostdataaccessisforrecentdata▪Optimizetablelayo

8、utforrecency▪Archiveolderdata▪Don’teverstorenon