信息论与纠错编码

《信息论与纠错编码》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。

1、《ElementsofInformationandEncodingTechnology》MaincontentsChapter1IntroductionChapter2SourceandInformationEntropyChapter3ChannelandChannelCapacityChapter4RateDistortionFunctionChapter5SourceEncodingChapter6ChannelEncodingChapter1IntroductionMaincontents:Conceptionsofinformation,messageandsig

2、nalStudyobject,aimandcontentofinformationtheoryShannontheoryConceptionsofinformationInformation:StateandthewaystatechangesItisakindofconsciousnessorknowledgewhichcannotbeseenortouchedItisacoreofmessageConceptionsofmessageMessageAkindoflanguage,wordorimagewhichincludeinformationItisacarrier

3、ofinformationConceptionsofsignalSignalItistheembodimentofmessage,inordertosendmessageinchannelwemustloaditontosomekindofsignalwhichhasphysicalcharactersStudyobjectofinformationtheoryThemodelofcommunicationsystemisthestudyobjectofinformationtheoryStudyaimofinformationtheoryFindthecommonrule

4、ofmessagetransmittingproceduretoimprovethereliability,effectiveness,securityandtogettheoptimalmessagetransmittingsystem.StudycontentsofinformationtheoryInformationtheoryinnarrowsenseGeneral(applied)informationtheoryInformationtheoryinbroadsenseInformationtheoryinnarrowsenseItisthebasictheo

5、ryofinformationtheory,italsocalledShannontheory.Itincludes:source,themeasurementofinformation,sourcecoding;channel,channelcapacityandchannelcodingetc.GeneralinformationtheoryBesidesbasictheory,italsoincludes:noisetheory,signalfilteringandforecast,statisticdetection,estimationtheoryandmodul

6、ationtheoryetc.InformationtheoryinbroadsenseBesidesabovetwoaspects,itincludesallkindsofnaturalandsocialfieldswhichrelatetoinformation.ShannontheoryThreeviewpointsofShannon1.Informationhypothesis2.Undetermined3.UncertaintyThecoreofShannontheory1.Sourceencodingtheory2.ChannelencodingtheoryIn

7、formalhypothesisMessagearetransferredwithoutconsideringtheirsemanticinformationanduse.Informalhypothesismakeitpossibletoquantitivelymeasureinformationbymathematicalmethod.UndeterminedCommunicationsystemisdesignedforunknownsituation.(Undetermined)Solvetheproble