【t112017-数据工程和技术分会场】tidb+as+an+htap+database

《【t112017-数据工程和技术分会场】tidb+as+an+htap+database》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、TiDBasanHTAPDatabase主讲人：PingCapCEO刘奇Aboutme•CEOandco-founderofPingCAP•Opensourcehacker•Infrastructureengineer•FounderofTiDB/TiKV/Codis•Infrastructuresoftwareengineer•Wandoulabs/JDWhyanewdatabase?BriefHistoryRDBMSNoSQLNewSQL●StandaloneRDBMS1970s20102015Present●NoSQL●Middleware&ProxyRedis

2、GoogleSpannerMySQLHBaseGoogleF1●NewSQLPostgreSQLCassandraTiDBOracleMongoDBDB2......NewSQLDatabase●HorizontalScalability●ACIDTransaction●HighAvailability●SQLatScaleOLTP&OLAPOLTPOLAPETL8am2pm6pm2amDatabaseWhereismydata?ERPIsthedataout-of-date?DataWarehouseCRMWhytwoseparatesystems●Hugedata

3、size●Complexquerylogic●LatencyVSThroughput●PointqueryVSFullrangescan●Transaction&lsolationlevelOLAP+OLTP=HTAPHybridTransactional/AnalyticalProcessing●ACIDTranscation●Real-timeanalysis●SQLHTAPHowdowebuildthenewdatabaseWhatisTiDB●Scalabilityasthefirstclassfeature●SQLisnecessary●Compatible

4、withMySQL,inmostcases●OLTP+OLAP=HTAP(HybridTransactional/AnalyticalProcessing)●24/7availability,evenincaseofdatacenteroutages●Opensource,ofcourseArchitectureStatelessSQLLayerMetadata/TimestamprequestTiDB...TiDB...TiDBPlacementDriver(PD)RaftRaft...RaftTiKVTiKVTiKVTiKVControlflow:Balance/

5、FailoverDistributedStorageLayerTiKV-Overview•Region:asetofcontinuouskey-valuepairs•Dataisorganized/stored/replicatedbyRegions•HighlylayeredTiKVKeySpaceRPC(gRPC)NodeATransaction256MBMVCC[start_key,Raftend_key)RocksDB(-∞,+∞)RaftRaftSortedMapNodeBNodeCRaftTiKV-Multi-RaftMultipleraftgroupsi

6、nthecluster,onegroupforeachregion.ClientRPCRPCRPCRPCStore1Store2Store3Store4Region1Region1Region2Region1Region3Region2Region5Region2RaftRegion5Region4Region3Region5GroupRegion4Region4Region3TiKVnode1TiKVnode2TiKVnode3TiKVnode4TiKV-HorizontalScaleNodeBRegion1^Region1Region2Region3Region1

7、*NodeDRegion2Region2Region3Region3NodeCNodeAAddReplicaThreestepstomovealeaderreplica●TransferLeader●AddReplicaNodeE●RemoveReplicaPD-Overview•Metadatamanagement•LoadbalancemanagementRouteInfoTiKVClientPDNode/RegionManagementInfoCommandTiKVClusterTiKVTiKVTiKV…...TiKVPD-TiKVCluste