Lessons From Building and Scaling LinkedIn_Jay Kreps.pdf

《Lessons From Building and Scaling LinkedIn_Jay Kreps.pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、LessonsFromBuildingandScalingLinkedInJayKrepswhat’schanged?•datasize•traffic•#engineers•codesizewhatdidIlearn?scalingthesite#1:scalabilityisaboutmanagingstateandstatebelongsindatasystemsinthebeginning……goingdistributed……andnow#2:makesimplecheapscalableprimitives#3:opsfirst#4:doha

2、rdthingslaterLinkedIndatasystems•Voldemort—key/valuestorage–400kpeakqueriespersecond–400tables•Kafka—messaging–460kpeakuniquemessagewritespersecond–2.3mpeakmessagereads•GraphDB—graphoperations–80kpeakqueriespersecond•Hadoop—batchprocessingandanalytics–5000nodes–17PB–30,000jobsper

3、day–700usersservicescuttinguptheapplicationinthebeginning……goingdistributed…..andnow#5:services(may)scaledevelopment#6:BadServices<

4、nscalingsoftwareengineeringcuttingupthecodebase#9:buildyourprocesswemodelthecompletelifecycle:reviewcheckinbuildrolloutgovernancecommunismvscapitalism#10:treatcodeasproperty#11:butyouneedeffectivegovernment#12:don’tduplicateintegrationlayersagilityatscale#14:agilityrequiressafety

5、twocheersfortestingtestsarefocusedonpredictingthingsthatwillgowrong#15:measurement>predictionhowtomeasurecost?#16:reducetimeinerrororexposuretoerrorjay.kreps@linkedin.comhttp://www.linkedin.com/in/jaykreps@jaykreps