资源描述：
《_信息论之父Shannon的经典之作：《通信的数学理论》.pdf》由会员上传分享，免费在线阅读，更多相关内容在行业资料-天天文库。
1、ReprintedwithcorrectionsfromTheBellSystemTechnicalJournal,Vol.27,pp.379–423,623–656,July,October,1948.AMathematicalTheoryofCommunicationByC.E.SHANNONINTRODUCTIONHErecentdevelopmentofvariousmethodsofmodulationsuchasPCMandPPMwhichexchangebandwidthforsignal-to-noiser
2、atiohasintensifiedtheinterestinageneraltheoryofcommunication.ATbasisforsuchatheoryiscontainedintheimportantpapersofNyquist1andHartley2onthissubject.Inthepresentpaperwewillextendthetheorytoincludeanumberofnewfactors,inparticulartheeffectofnoiseinthechannel,andthesav
3、ingspossibleduetothestatisticalstructureoftheoriginalmessageandduetothenatureofthefinaldestinationoftheinformation.Thefundamentalproblemofcommunicationisthatofreproducingatonepointeitherexactlyorap-proximatelyamessageselectedatanotherpoint.Frequentlythemessageshave
4、meaning;thatistheyrefertoorarecorrelatedaccordingtosomesystemwithcertainphysicalorconceptualentities.Thesesemanticaspectsofcommunicationareirrelevanttotheengineeringproblem.Thesignificantaspectisthattheactualmessageisoneselectedfromasetofpossiblemessages.Thesystemm
5、ustbedesignedtooperateforeachpossibleselection,notjusttheonewhichwillactuallybechosensincethisisunknownatthetimeofdesign.Ifthenumberofmessagesinthesetisfinitethenthisnumberoranymonotonicfunctionofthisnumbercanberegardedasameasureoftheinformationproducedwhenonemessa
6、geischosenfromtheset,allchoicesbeingequallylikely.AswaspointedoutbyHartleythemostnaturalchoiceisthelogarithmicfunction.Althoughthisdefinitionmustbegeneralizedconsiderablywhenweconsidertheinfluenceofthestatisticsofthemessageandwhenwehaveacontinuousrangeofmessages,wew
7、illinallcasesuseanessentiallylogarithmicmeasure.Thelogarithmicmeasureismoreconvenientforvariousreasons:1.Itispracticallymoreuseful.Parametersofengineeringimportancesuchastime,bandwidth,numberofrelays,etc.,tendtovarylinearlywiththelogarithmofthenumberofpossibilitie
8、s.Forexample,addingonerelaytoagroupdoublesthenumberofpossiblestatesoftherelays.Itadds1tothebase2logarithmofthisnumber.Doublingthetimeroughlysquaresthenu
