资源描述：
《theory information(shannon)》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、ReprintedwithcorrectionsfromTheBellSystemTechnicalJournal,Vol.27,pp.379–423,623–656,July,October,1948.AMathematicalTheoryofCommunicationByC.E.SHANNONINTRODUCTIONHErecentdevelopmentofvariousmethodsofmodulationsuchasPCMandPPMwhichexchangebandwidthforsignal-to-noiseratiohasintens
2、ifiedtheinterestinageneraltheoryofcommunication.ATbasisforsuchatheoryiscontainedintheimportantpapersofNyquist1andHartley2onthissubject.Inthepresentpaperwewillextendthetheorytoincludeanumberofnewfactors,inparticulartheeffectofnoiseinthechannel,andthesavingspossibleduetothestatis
3、ticalstructureoftheoriginalmessageandduetothenatureofthefinaldestinationoftheinformation.Thefundamentalproblemofcommunicationisthatofreproducingatonepointeitherexactlyorap-proximatelyamessageselectedatanotherpoint.Frequentlythemessageshavemeaning;thatistheyrefertoorarecorrelate
4、daccordingtosomesystemwithcertainphysicalorconceptualentities.Thesesemanticaspectsofcommunicationareirrelevanttotheengineeringproblem.Thesignificantaspectisthattheactualmessageisoneselectedfromasetofpossiblemessages.Thesystemmustbedesignedtooperateforeachpossibleselection,notju
5、sttheonewhichwillactuallybechosensincethisisunknownatthetimeofdesign.Ifthenumberofmessagesinthesetisfinitethenthisnumberoranymonotonicfunctionofthisnumbercanberegardedasameasureoftheinformationproducedwhenonemessageischosenfromtheset,allchoicesbeingequallylikely.Aswaspointedout
6、byHartleythemostnaturalchoiceisthelogarithmicfunction.Althoughthisdefinitionmustbegeneralizedconsiderablywhenweconsidertheinfluenceofthestatisticsofthemessageandwhenwehaveacontinuousrangeofmessages,wewillinallcasesuseanessentiallylogarithmicmeasure.Thelogarithmicmeasureismorecon
7、venientforvariousreasons:1.Itispracticallymoreuseful.Parametersofengineeringimportancesuchastime,bandwidth,numberofrelays,etc.,tendtovarylinearlywiththelogarithmofthenumberofpossibilities.Forexample,addingonerelaytoagroupdoublesthenumberofpossiblestatesoftherelays.Itadds1tothe
8、base2logarithmofthisnumber.Doublingthetimeroughlysquaresthenu
