哥伦比亚大学经典自然语言处理公开课,数学之美中盛赞的柯林斯(Michael Collins)教授授课

AINLP

3d和值振幅连线走势图gelunbiyadaxuenanshen michael collins dejuebanziranyuyanchuligongkaike(natural language processing),kechengzhuye:

这门课程大致录制于2013年左右,也是深度学习NLP的史前经典NLP课程,适合修完斯坦福NLP入门课程之后继续学习。我们建立了一个NLP入门学习群,感兴趣的同学可以添加微信AINLPer(id: ainlper) ,备注“NLP入门”进群一起交流学习。

3d和值振幅连线走势图guanyuzheimenkecheng,zaoqiyouyixietongxuezaililiuyanpingjiaguo,yixiaxuanzejitiaogongdajiacankao:

3d和值振幅连线走势图“feichanghaodeyimenke,buxiangqitakechengneimeshui,wanwanzhengzhengdegelunbiyakecheng,ruguorenzhenxuewankendingshouhuohenduo,huadeshijianjueduiwuyousuozhi。kelinsidejiangjiefeichangqingxi,neironghangaileyuyanjianmo,jiemasuanfa,xuexisuanfajigefangmian。

3d和值振幅连线走势图yuyanjifanyimoxing:nyuanmoxing,hmmmoxing,log-linearmoxing,glmmoxing,ibm 1moxing,ibm2 moxing,phrase-basedfanyimoxing,pcfgyufa,lpcfgyufa

jiemasuanfa:viterbisuanfa,ckysuanfa,glm viterbisuanfa

xuexisuanfa:brownjuleisuanfa,perceptronsuanfa,emsuanfa

3d和值振幅连线走势图yingyongjuli:cixingbiaozhu/shitishibie(hmm, glm, log-linear),yufashubiaozhu(pcfg, dependecny-based),jiqifanyi”

=========================================================================================

“proferssor collinsjiangkeshifenqingxi,kechengdatifugaidaolenlpdebijiaojichudeneirong,bianchengzuoyeshifenjuyouzhenduixing,youyubushitebieshuxipython,wozuoqilaitebiefeijing,jibenshangmeigepawodouzuole10xiaoshiyishang。kechengnanduzhongshang,jianyiyouyidingpythonhemachine learningjichudetongxuexuexi。”

=========================================================================================

“gensitanfuneimennlpbiqilai,zheimendelilunxinggengqiang,xueqilaiyeshaoweikuzaoyidian,danshigezhongmoxingjiangdehenjiandanmingle,tuijiankanlesitanfudenlphouzailaixuezheige”

3d和值振幅连线走势图wobazheimenkechengzhenglileyixiaanzhangjiefangzailebzhan,ganxingqudetongxuekeyiguanzhu,ruguonixuyaoshipinkejianzimuzhileidedabaowenjian,keyiguanzhuwomendegongzhonghao,huifu“collins"huoqubaiduwangpanlianjie:

gelunbiyadaxueziranyuyanchuligongkaike-diyijiangkechengjieshao

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dierjiangyuyanmoxing

gelunbiyadaxueziranyuyanchuligongkaike-disanjiangyuyanmoxingcanshugujidisijiangzongjie

gelunbiyadaxueziranyuyanchuligongkaike-diwujiangcixingbiaozhuheyinmaerkefumoxing

gelunbiyadaxueziranyuyanchuligongkaike-diliujiangjufafenxiheshangxiawenwuguanwenfa

gelunbiyadaxueziranyuyanchuligongkaike-diqijianggailvshangxiawenwuguanwenfa

gelunbiyadaxueziranyuyanchuligongkaike-dibajiangdijiujianggailvshangxiawenwuguanwenfaderuodianyijicifahua

gelunbiyadaxueziranyuyanchuligongkaike-dishijiangjiqifanyijieshao

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dishiyijiangibmfanyimoxing

gelunbiyadaxueziranyuyanchuligongkaike-dishierjiangjiyuduanyudejiqifanyimoxing

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dishisanjiangjiqifanyijiemasuanfa

zhu:shipinyizhizaibzhanshenhe,shenhetongguohougengxinlianjie,huozhetongguowangpanlianjiehuoqu

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dishisijiangduishuxianxingmoxing

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dishiwujiangjiyuduishuxianxingmoxingdecixingbiaozhu

3d和值振幅连线走势图gelunbiyadaxueziranyuyanchuligongkaike-dishiliujiangjiyuduishuxianxingmoxingdejufafenxi

gelunbiyadaxueziranyuyanchuligongkaike-dishiqijiangwujianduxuexi

gelunbiyadaxueziranyuyanchuligongkaike-dishibajiangguangyixianxingmoxing

gelunbiyadaxueziranyuyanchuligongkaike-dishijiujiangjiyuguangyixianxingmoxingdecixingbiaozhu

gelunbiyadaxueziranyuyanchuligongkaike-diershijiangjiyuguangyixianxingmoxingdeyicunjufafenxi

guanyucollinsjiaoshou,wozuizaoshicongwujunlaoshide《shuxuezhimei》lilejiedaode,zai“shuxuezhimei xilieshiwu fanyujian ziranyuyanchulidejiweijingying”,shizheiyangmiaoshu collins jiaoshoude:

kelinsi:zhuiqiuwanmei

kelinsicongshiyuziranyuyanchulidashimakusi (mitch marcus)(womenyihouhaihuiduocitidaomakusi),congbinxifaliyadaxuehuodeboshixuewei,xianrenmashengligongxueyuan (mit) fujiaoshou(biekantashifujiaoshou,tadeshuipingzaidangjinziranyuyanchulilingyushishuyishuerde),zaizuoboshiqijian,kelinsixieleyigehoulaiyitamingzimingmingdeziranyuyanwenfafenxiqi (sentence parser),keyijiangshumianyudemeiyijuhuazhunquedijinxingwenfafenxi。wenfafenxishihenduoziranyuyanyingyongdejichu。suirankelinsideshixiongbulaier (eric brill) he ratnaparkhi yijishidi eisnar douwanchenglexiangdangbucuodeyuyanwenfafenxiqi,danshikelinsiquejiangtazuodaolejizhi,shitazaixiangdangzhangyiduanshijianneichengweishijieshangzuihaodewenfafenxiqi。kelinsichenggongdeguanjianzaiyujiangwenfafenxidemeiyigexijiedouyanjiudehenzixi。kelinsiyongdeshuxuemoxingyehenpiaoliang,zhenggegongzuokeyiyongwanmeilaixingrong。wocengyinweiyanjiudexuyao,zhaokelinsiyaoguotawenfafenxiqideyuanchengxu,tahenshuangkuaidijilewo。woshitujiangtadechengxuxiugaiyixialaimanzuwotedingyingyongdeyaoqiu,danhoulaifaxian,tadechengxuxijietaiduoyizhiyuhennanjinyibuyouhua。kelinsideboshilunwenkanchengshiziranyuyanchulilingyudefanwen。taxiangyibenyouxiudexiaoshuo,basuoyoushiqingdelailongqumaijieshaodeqingqingchuchu,duiyurenheyouyidianjisuanjiheziranyuyanchulizhishideren,doukeyiqingeryijudidudongtafuzadefangfa。

kelinsibiyehou,zai at&t shiyanshiduguolesanniankuailedeshiguang。zaineilikelinsiwanchenglexuduoshijieyiliudeyanjiugongzuozhuruyinhanmaerkefumoxingdequbiexingxunlianfangfa,juanjihezaiziranyuyanchulizhongdeyingyongdengdeng。sannianhou,at&t tingzhileziranyuyanchulifangmiandeyanjiu,kelinsixingyundizai mit zhaodaolejiaozhi。zai mit deduanduanjinianjian,kelinsiduocizaiguojihuiyishanghuodezuijialunwenjiang。xiangbiqitatongxing,zheizhongchengjiushiduyiwuerde。kelinsidetedianjiushibashiqingzuodaojizhi。ruguoshuoyourenxihuan“fansuozhexue”,kelinsijiushiyige。

自动作诗机&藏头诗生成器:五言、七言、绝句、律诗全了

AINLP

这是自然语言处理里面最有意思的任务之一:自然语言生成,本文主要是指古诗自动写诗,或者自动作诗机藏头诗生成器,目前支持五言绝句、七言绝句、五言律诗、七言律诗的自动生成(给定不超过7个字的开头内容自动续写)和藏头诗生成(给定不超过8个字的内容自动合成)。先看一下效果,也算是一个简单的自动作诗机和藏头诗生成器使用指南,感兴趣的同学请关注公众号AINLP,直接关键词触发测试:

自动作诗机或者自动写诗:
输入 “写诗 起头内容” 触发古诗自动生成(自动续写),输入内容不要超过7个字,会根据字数随机生成几首五言绝句、七言绝句、五言律诗、七言律诗:

藏头诗生成器:
输入 “藏头诗 藏头内容” 触发藏头诗自动生成,输入内容不超过8个字,会根据字数随机生成绝句或者律诗:

五言诗生成器:
输入“五言 起头内容” 触发五言诗自动生成,输入内容不要超过5个字,会随机生成五言绝句或者五言律诗

七言诗生成器:
输入 “七言 起头内容” 触发七言诗自动生成,输入内容不要超过7个字,会随机生成七言绝句或者七言律诗

绝句生成器:
输入 “绝句 起头内容” 触发绝句自动生成,输入内容不要超过7个字,会根据字数随机生成五言绝句或者七言绝句

律诗生成器:
输入 “律诗 起头内容” 触发律诗自动生成,输入内容不要超过7个字,会根据字数随机生成五言律诗或者七言律诗

五言绝句生成器和五言律诗生成器:
输入 “五言绝句 起头内容” 触发五言绝句自动生成,输入 “五言律诗 起头内容” 触发五言律诗自动生成,输入内容不要超过5个字:

七言绝句生成器和七言律诗生成器:
输入 “五言绝句 起头内容” 触发五言绝句自动生成,输入 “五言律诗 起头内容” 触发五言律诗自动生成,输入内容不要超过5个字:

最后让我们再看一下藏头诗自动生成的功能,支持任意8个字以内的输入,以下是对“自然语言”, “自然语言处理”,“我爱自然语言处理”的输入测试:

关于机器自动写诗,我们已经谈到多次,请参考:
AINLP公众号自动作诗上线
用GPT-2自动写诗,从五言绝句开始
鼠年春季,用GPT-2自动写对联和对对联

muqianyong zheigegongjuduigushiheduilianshujuyiqixunlian,shejihaoshujugeshi,dangemoxingkeyiyizhanshizhichiduozhongticaigushiheduilianshengcheng,feichangfangbian,zaicianli。

3d和值振幅连线走势图guanyugushiticaijieshao,yixialaiyuanyubaike:

3d和值振幅连线走势图wuyanjuejushizhongguochuantongshigedeyizhongticai,jianchengwujue,shizhiwuyansijueryouhehulvshiguifandexiaoshi,shuyujintishifanchou。citiyuanyuhandailefuxiaoshi,shenshouliuchaomingeyingxiang,chengshudingxingyutangdai。wujuemeishoujinershizi,biannengzhanxianchuyifufuqingxindetuhua,chuandayizhongzhongzhenqiedeyijing。yinxiaojianda,yishaozongduo,zaiduanzhangzhongbaohanzhefengfudeneirong,shiqizuidatese。wujueyouzeqi、pingqierge。daibiaozuopinyouwangweide《niaomingjian》、libaide《jingyesi》、dufude《bazhentu》、wangzhihuande《dengguanquelou》、liuzhangqingde《songlingcheshangren》deng。

qiyanjuejushizhongguochuantongshigedeyizhongticai,jianchengqijue,shuyujintishifanchou。citiquanshisiju,meijuqiyan,zaiyayun、zhanduidengfangmianyouyangedegelvyaoqiu。shitiqiyuanyunanchaolefugexinghuobeichaolefuminge,huokezhuisudaoxijindeminyao,dingxing、chengshuyutangdai。daibiaozuopinyouwangchanglingde《furonglousongxinjianershou》、libaide《zaofabaidicheng》、dufude《jiangnanfengliguinian》、lishengjiaode《guanchaoyougan》deng。

wuyanlvshi,shizhongguochuantongshigedeyizhongticai,jianchengwulv,shuyujintishifanchou。citifayuanyunanchaoqiyongmingshiqi,qichuxingshishenyuedengjiangjiushenglv、duioudexintishi,zhichutangshenquanqi、songzhiwenshijibendingxing,chengshuyushengtangshiqi。quanpiangongbaju,meijuwugezi,youzeqi、pingqiliangzhongjibenxingshi,zhongjianlianglianxuzuoduizhang。daibiaozuopinyoulibaide《songyouren》、dufude《chunwang》、wangweide《shanjuqiuming》、lishengjiaode《xinmaojichunyelihangergongci》deng。

3d和值振幅连线走势图qiyanlvshishizhongguochuantongshigedeyizhongticai,jianchengqilv,shuyujintishifanchou,qiyuanyunanchaoqiyongmingshishenyuedengjiangjiushenglv、duioudexintishi,zhichutangshenquanqi、songzhiwendengjinyibufazhandingxing,zhishengtangdufushouzhongchengshu。qigelvyanmi,yaoqiushijuzishuzhengqihuayi,youbajuzucheng,meijuqigezi,meiliangjuweiyilian,gongsilian,fenshoulian、hanlian、jinglianheweilian,zhongjianlianglianyaoqiuduizhang。daibiaozuopinyoucuihaode《huanghelou》、dufude《denggao》、lishangyinde《andingchenglou》deng。

斯坦福大学自然语言处理经典入门课程-Dan Jurafsky 和 Chris Manning 教授授课

AINLP

zheimenkechengluzhiyushenduxuexibaofaqianxi,shoukeshisitanfujiaoshou he jiaoshou,liangweidoushiziranyuyanchulilingyudeshenniu:qianzhexiele《speech and language processing》(zhongwenyiming:ziranyuyanchulizonglun),muqiandisanbanslp3haizaigengxinzhong;houzhexiele《foundations of statistical natural language processing》(zhongwenyiming:tongjiziranyuyanchuli)he《introduction to information retrieval》(zhongwenyiming:xinxijiansuodaolun),zheijibenshujihushinlperdebidushu。zheimenkechengshihenlprumenxuexi,keyilejiejibendeziranyuyanchulirenwuhezaoqijingdiandechulifangfa,yijihexinxijiansuoxiangguandeyixiefangfa。wobazheimenkechengzhenglileyixiaanzhangjiefangzailebzhan,ganxingqudetongxuekeyiguanzhu。

sitanfuziranyuyanchulijingdianrumenkecheng-diyijiangkechengjieshaojidierjiangzhengzebiaodashi

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-disanjiangbianjijuli

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-disijiangyuyanmoxing

sitanfuziranyuyanchulijingdianrumenkecheng-diwujiangpinxiejiucuo

sitanfuziranyuyanchulijingdianrumenkecheng-diliujiangwenbenfenlei

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-diqijiangqingganfenxi

sitanfuziranyuyanchulijingdianrumenkecheng-dibajiangshengchengmoxingpanbiemoxingzuidashangmoxingfenleiqi

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-dijiujiangmingmingshitishibiener

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-dishijiangguanxichouqu

sitanfuziranyuyanchulijingdianrumenkecheng-dishiyijiangzuidashangmoxingjinjie

sitanfuziranyuyanchulijingdianrumenkecheng-dishierjiangcixingbiaozhu

sitanfuziranyuyanchulijingdianrumenkecheng-dishisanjiangjufafenxi

sitanfuziranyuyanchulijingdianrumenkecheng-dishisi、shiwujianggailvjufafenxi

sitanfuziranyuyanchulijingdianrumenkecheng-dishiliujiangcifafenxi

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-dishiqijiangyicunjufafenxi

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-dishibajiangxinxijiansuo

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-dishijiujiangxinxijiansuojinjie

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-diershijiangyuyixue

sitanfuziranyuyanchulijingdianrumenkecheng-diershiyijiangwendaxitong

3d和值振幅连线走势图sitanfuziranyuyanchulijingdianrumenkecheng-diershierjiangwenbenzhaiyaoershisanjiangwanjiepian

斯坦福自然语言处理经典入门课程-第一讲课程介绍及第二讲正则表达式

AINLP

3d和值振幅连线走势图zheimenkechengluzhiyushenduxuexibaofaqianxi,shoukeshisitanfujiaoshou dan jurafsky he christopher manning jiaoshou,liangweidoushiziranyuyanchulilingyudeshenniu:qianzhexiele《speech and language processing》(zhongwenyiming:ziranyuyanchulizonglun),houzhexiele《foundations of statistical natural language processing》(zhongwenyiming:tongjiziranyuyanchulijichu),zheiliangbenshujihushinlperdebidushu。zheimenkechengshihenlprumenxuexi,keyilejiejibendeziranyuyanchulirenwuhezaoqijingdiandechulifangfa。

3d和值振幅连线走势图zheishidiyijiangkechengjieshaohedierjiangzhengzebiaodashidexiangguanneirong,shihuashishuo,zhengzebiaodashizaigongzuozhongyongdexiangdangzhiduole。

李宏毅老师2020新课深度学习与人类语言处理正式开放上线

AINLP

qianliangtianlihongyilaoshijiqixuexi2020banganggangshangxian,zheimetayoumabutingtidetuichuleyouyikuanliangxindazuo:shenduxuexiyurenleiyuyanchuli (deep learning for human language processing),feichangshihenlpermenlaizhui!

kechengzhuye,baohanshipinheqitaxiangguanziliaolianjie,jianyibaocun:

http://speech.ee.ntu.edu.tw/~tlkagk/courses_dlhlp20.html

3d和值振幅连线走势图kanlediyijiekechengshipin,zheimenkechengzhisuoyijiaozuoshenduxuexiyurenleiyuyanchuli,erbushishenduxuexiyuziranyuyanchuli,zhuyaoshizheimenkechengliwenziheyuyindeneironggezhanyiban,lingwaizhuyaoguanzhujin3niandexiangguanjishu,pirubertjizhihoudeyuchulimoxingjiangzhongdianjiangshu,feichangzhideqidai。womenjianlileyigezheimenkechengdexuexijiaoliuqun,ganxingqudetongxuekeyitianjiaweixinainlper(id: ainlper) ,beizhu“lihongyi”jinqunyiqijiaoliuxuexi。

muqianzheimenkechengyijingfangchule2jiekechengneirong,fenbieshikechenggailanheyuyinshibiediyibufen,ganxingqudetongxuekeyizhijieguankan:

3d和值振幅连线走势图ruguojuedezheigehaibuguoyin,keyiguanzhuainlpgongzhonghao,huifu"dlhlp",huoquzheimenkechengqian2jiekechengshipinheslides,yihouhuichixugengxinxiangguanziliao。

关于AINLP

3d和值振幅连线走势图ainlp shiyigeyouquyouaideziranyuyanchulishequ,zhuanzhuyu ai、nlp、jiqixuexi、shenduxuexi、tuijiansuanfadengxiangguanjishudefenxiang,zhutibaokuowenbenzhaiyao、zhinengwenda、liaotianjiqiren、jiqifanyi、zidongshengcheng、zhishitupu、yuxunlianmoxing、tuijianxitong、jisuanguanggao、zhaopinxinxi、qiuzhijingyanfenxiangdeng,huanyingguanzhu!jiajishujiaoliuqunqingtianjiaainlpjunweixin(id:ainlp2),beizhugongzuo/yanjiufangxiang+jiaqunmude。

用 GPT-2 自动写诗,从五言绝句开始

AINLP

春节前用 GPT2 训练了一个自动对联系统:鼠年春节,用 GPT-2 自动生成(写)春联和对对联 ,逻辑上来说这套NLG方法论可以应用于任何领域文本的自动生成,当然,格式越固定越好,这让我自然想到了自动写诗词,诗词的格式相对比较固定,我们之前已经有所涉及,譬如已经在AINLP公众号上上线了自动写藏头诗首字诗的功能,不过是直接复用的: ,另外还有一个更大的诗词数据项目可以用作自动作诗的“原料”:,加上 GPT2-Chinese 这个项目: ,可以说万事俱备,只欠试用。

3d和值振幅连线走势图suoyibenzhouwomencongwuyanjuejukaishijixuziranyuyanshengchengdezhuti,guanyuwuyanjueju,baidubaikeshizheiyangshuode:

wuyanjuejushizhongguochuantongshigedeyizhongticai,jianchengwujue,shizhiwuyansijueryouhehulvshiguifandexiaoshi,shuyujintishifanchou。citiyuanyuhandailefuxiaoshi,shenshouliuchaomingeyingxiang,chengshudingxingyutangdai。wujuemeishoujinershizi,biannengzhanxianchuyifufuqingxindetuhua,chuandayizhongzhongzhenqiedeyijing。yinxiaojianda,yishaozongduo,zaiduanzhangzhongbaohanzhefengfudeneirong,shiqizuidatese。wujueyouzeqi、pingqierge。daibiaozuopinyouwangweide《niaomingjian》、libaide《jingyesi》、dufude《bazhentu》、wangzhihuande《dengguanquelou》、liuzhangqingde《songlingcheshangren》deng。

wozhuyaoyongle lide《quantangshi》he《quansongshi》shuju ,shouxianxiangzheigexiangmudezuozhezhijing:

《quantangshi》shiqingkangxisishisinian(1705nian),pengdingqiu、shensanceng、yangzhongne、wangshihong、wangyi、yumei、xushuben、chedingjin、panconglv、chasili10renfengchibianxiao,“deshisiwanbaqianjiubaiyushou,fanerqianerbaiyuren”, gongji900juan,mulu12juan。 laizibaike

《quansongshi》jitangshidegaodufanrongzhihou,songshizaisixiangneirongheyishubiaoxianshangyouxindekaituohechuangzao,chuxianlexuduoyouxiuzuojiazuopin,xingchenglexuduoliupai,duiyuan、ming、qingdeshigefazhanchanshengleshenyuanyingxiang。

说明
《全唐诗》和《全宋诗》是繁体存储, 如有需要请自己转换, 但转换后的字不符合上下文。

这里需要首先通过OpenCC做了繁简转换,其次提取里面的五言绝句,最后转换为 GPT2-Chinese 的训练格式,然后就是训练和测试了,感兴趣的同学可以自己尝试,很方便,训练经验可以复用上文关于自动对联的:

1)训练数据可以按 GPT2-Chinese 训练数据的格式要求写个脚本进行转换,可以加一些标记符,这样在生成的时候可以基于这些标记符做trick;
2)训练时请将参数 min-length 设置为一个较小的数字,默认为128,由于对联数据长度比较短,按默认的设置训练后只会得到乱码,我直接设置为1;
3)根据自己GPU显存的大小调整 batch_size 和配置参数, 这里 batch_size 默认为8,训练时在1080TI的机器上会出现OOM,将其设置为4就可以完全跑通了,其他参数不用动;

3d和值振幅连线走势图zidongzuoshigpt2moxingxunlianwanchenghou,keyizhijiejiyu gpt2-chinese limiande generate.py jiaobenjinxingceshi,henfangbian,wojiyu generate.py he flask-restful xieleyige server banben,duijiedaoainlpgongzhonghaohoutaile,ganxingqudetongxuekeyiguanzhuainlpgongzhonghao,zhijiejinxingceshi:

guanjianci“xieshi/zuoshi”chufashigedezidongshengcheng,lirushuru“xieshichun”,zidongzuoshimoxinghuijiyu“chun”jinxingzidongxuxie,huijichuyi“chun”kaitoudeshi,jichuqitadezitongli,muqianbunengduoyuwugezi,yinweizhinengzidongshengchengwuyanjueju:

关键词“藏头诗”触发藏头诗3d和值振幅连线走势图生成,例如输入“藏头诗春夏秋冬",基于GPT2模型叠加trick生成:

zuihou,huanyingguanzhuainlpgongzhonghao,ceshizidongxieshizuoshihezangtoushishengchengqigongneng:

3d和值振幅连线走势图guanyuainlpduihuagongnengmokuai,ganxingqudetongxuekeyicankao:

腾讯词向量和相似词、相似度、词语游戏系列





NLP相关工具及在线测试(公众号对话测试)






自动对联及作诗机



夸夸聊天机器人及其他技能







如果对AINLP公众号感兴趣,也欢迎参考我们的年度阅读清单:AINLP年度阅读收藏清单

鼠年春节,用 GPT-2 自动生成(写)春联和对对联

AINLP

鼠年春节临近,来试试新的基于 GPT2-Chinese 自动对联系统:自动写对联(输入开头进行对联自动生成)和自动对对联(输入上联自动写下联)。老的自动对联功能是去年基于深度学习机器翻译模型上线的一个自动对对联的对话模块:风云三尺剑,花鸟一床书---对联数据集和自动对联机器人

zheiyinianlai,yibertweidaibiaodeyuxunlianmoxingbuduantuichenchuxin,xijuanzhenggeziranyuyanchuli(nlp)lingyu,zheiqizhongnlpdenantizhiyiziranyuyanshengcheng(nlg)yededaolehendadezhuli,tebieshiqunianshangbannian openai de gpt-2 detuichu,feichangjingyan,buguo gpt-2 demoxingzhuyaoshijiyuyingwenlingyudeyuliaoxunliande,suirandaomuqianweizhiyijingfabulehanyou15yicanshudewanzhengmoxing,duiyuyingwenlingyudezidongwenbenshengchengfeichangyoubangzhu,danshiduiyuzhongwenlingyudenlglaishuohaishihenshouxian。

huidaozhongwenlingyu,womenzhiqiantuijianguoainlpjishujiaoliuqunduzeyaotongxuedekaiyuanxiangmu gpt2-chinese::《》,zheigexiangmukeyizhenduizhongwenshujujinxinggpt-2moxingdexunlian,keyixieshi,xinwen,xiaoshuo,huoshixunliantongyongyuyanmoxing。suoyiduiyuzidongduilianshengchenglaishuo,wonengxiangdaodejiushijiyugpt2-chineseheduilianshujuxunlianyifenduilianlingyudegpt2moxing,yongyuduilianzidongshengcheng:xieduilianheduiduilian。xingyundeshi,duilianshujuyijingyoule,yiranshiwomenqunianshiyongguo ,tebieganxietigongzheifenshujudetongxue,zheifenduilianshujubaohan70duowantiaoduilian,weiyikexideshimeiyouhengpi,yaoshiyouhengpi,jiukeyizaogengwanzhengdezidongxieduilianheduiduilianxitongle。

3d和值振幅连线走势图tebiexuyaoshuomingdeshi,zheilibingbushijiyuyigedadezhongwen gpt-2 moxingjinxingtedinglingyu finetune de,suiranmuqianyijingyouledaxingdezhongwen gpt-2 yuxunlianmoxing: ,danshihe gpt2-chinese shilianggetixi,er gpt2-chinese muqianhaibuzhichizheigedamoxingdeqianyi。guanyuruheshiyong gpt2-chinese jinxingduilianshujude gpt2 moxingxunlian,zheigexiangmudedaimahewendangdouxiedefeichangqingchu,zhijiecankaojike,ruguoyouwenti,keyichakanyixiaissue,woyudaodewentijibenshangjiushitongguowendangheissuejiejuede,zheilitijigezhuyidedian:

1)训练数据可以按 GPT2-Chinese 训练数据的格式要求写个脚本进行转换,可以加一些标记符,譬如开头,结尾以及上联下联之间的分隔符,这样在生成的时候可以基于这些标记符做trick;
2)训练时请将参数 min-length 设置为一个较小的数字,默认为128,由于对联数据长度比较短,按默认的设置训练后只会得到乱码,我直接设置为1;
3d和值振幅连线走势图 3)根据自己GPU显存的大小调整 batch_size 和配置参数, 这里 batch_size 默认为8,训练时在1080TI的机器上会出现OOM,将其设置为4就可以完全跑通了,其他参数不用动;

duilian gpt-2 moxingxunlianwanchenghou,keyizhijiejiyu gpt2-chinese limiande generate.py jiaobenjinxingceshi,henfangbian,wojiyu generate.py he flask-restful xieleyige server banben,duijiedaoainlpgongzhonghaohoutaile,ganxingqudetongxuekeyiguanzhuainlpgongzhonghao,zhijiejinxingceshi:

guanjianci“xieduilian”chufaduilianzidongshengcheng,lirushuru“xieduilianshunian”,duilianmoxinghuijiyu“shunian”jinxingzidongxuxie,huijichuyi“shunian”kaitoudagai3geduilian:

3d和值振幅连线走势图guanjianci“duiduilian”chufajiyushanglianduixialian,lirushuru“duiduilian yifanfengshunniannianhao”,huijichudagai3gehouxuanduilian:

3d和值振幅连线走势图dangrannikeyiyong“shanglian”chufalaodeduilianbanbenjinxingduibi:

3d和值振幅连线走势图zhiyulianggebanbendexiaoguo,huanyingduozuoduibi,ruguoyudaolehenbangdejiqiduilian,yehuanyingzaipinglunlifenxiang。zuihou,huanyingguanzhuainlpgongzhonghao,ceshizidongshengchengduilianhezidongduiduiliangongneng:

guanyuainlpduihuagongnengmokuai,ganxingqudetongxuekeyicankao:

腾讯词向量和相似词、相似度、词语游戏系列





NLP相关工具及在线测试(公众号对话测试)






自动对联及作诗机


夸夸聊天机器人及其他技能







如果对AINLP公众号感兴趣,也欢迎参考我们的年度阅读清单:AINLP年度阅读收藏清单

AINLP年度阅读收藏清单

AINLP

ganxiedajiadezhichi,zhudajiaxinniankuaile!jintianhualedabufenshijiancongqianwanghoufenleizhenglileyixiayueduqingdan,wenmofushanghenduoziyuandeguanjiancisuoyin,huanyingshouzanghefenxiang。ainlpzhiliyuzuoyigeyouquyouaideziranyuyanchulishequ,huanyingguanzhu:

如何学习NLP和NLP相关资源
















腾讯词向量和相似词、相似度、词语游戏系列





NLP相关工具及在线测试(公众号对话测试)






自动对联及作诗机


夸夸聊天机器人及其他技能







BERT及预训练模型3d和值振幅连线走势图相关的文章

张俊林博士系列解读:





高开远同学系列:









老宋的茶书会系列:




太子長琴同学系列:


张贵发同学系列:


艾力亚尔同学的文章:

SunYanCN同学的文章:

李如同学的文章:

其他相关:












中文分词



命名实体识别

关系提取





文本分类/情感分析







文本摘要



知识图谱


问答系统/对话系统/聊天机器人












阅读理解

机器翻译

文本生成

推荐系统






论文笔记



竞赛相关














求职相关



开源项目及资源


























其他相关





















资源关键字
AINLP聊天机器人除了日常搭讪外,还负责回复用户的日常查询,所以为一些关注度比较高的文章和NLP资源做了关键字和索引,分散在以前的一些文章介绍里,这里再统一贴出来:

1、guanzhuainlpgongzhonghao,houtaihuifu “wenzhang、lishixiaoxi、lishi、history、cundang” renyiguanjianzihuoqulishiwenzhangcundangxiaoxi。

3d和值振幅连线走势图2、huifu“zhengtaifenbu,rickjin, zhengtaifenbuqianshijinsheng, zhengtaifenbuwenzhang, zhengtaifenbu, zhengtai, zhengtai”renyiguanjianzihuoqurickjinzhengtaifenbuqianshijinshengxilie:

3、huifu“nlp, ziranyuyanchuli,xuexiziranyuyanchuli,xuexinlp, ruhexuexinlp,ruhexuexiziranyuyanchuli” renyiguanjianzihuoquwenzhang:

3d和值振幅连线走势图4、huifu"slp" huoqu:sitanfunlpshujihekechengwangpanlianjiehemima

3d和值振幅连线走势图5、huifu"slp3" huoqu:ziranyuyanchulizonglunyingwenbandisanbanjisitanfunlpkechenglianjiehemima

6、huifu"ng" huoqu:andrew nglaoshikechengxiangguanziliaolianjiehemima

7、回复"aic" 获取:
博客版本持续更新,欢迎提供线索:http://pfyc982.cn/?p=10998

8、回复"bert" 获取:
博客版本持续更新:http://pfyc982.cn/?p=10870

9、回复"HMM" 获取:HMM学习最佳范例全文PDF
HMM学习最佳范例全文PDF文档及3d和值振幅连线走势图相关的文章索引

10、回复"Hinton" 获取:面向机器学习的神经网络公开课视频及课件
Geoffrey Hinton 大神面向机器学习的神经网络公开课及相关视频资料

11、回复"NLTK" 获取: NLTK相关资料
Python自然语言处理工具NLTK学习导引及相关资料

12、回复"youhua"获取:优化相关资料
凸优化及无约束最优化相关资料

13、回复"xiandai"获取:线性代数相关资料
那些值得推荐和收藏的线性代数学习资源

14、回复"cs224n"获取:深度学习自然语言处理课程最新视频:
2019斯坦福CS224n深度学习自然语言处理课程视频和相关资料分享
斯坦福大学深度学习自然语言处理课程CS224N 2019 全20个视频分享

15、回复"kuakua"获取:夸夸语料库(500条)
为了夸夸聊天机器人,爬了一份夸夸语料库

16、回复"fenci"获取:中文分词相关资源
中文分词文章索引和分词数据资源分享

17、回复”tongjixuexi”获取:李航老师统计学习方法第一版PPT(清华大学深圳研究生院袁春老师精心制作)

18、回复"nmt"获取:Philipp Koehn大神的神经网络机器翻译学习资料:NMT Book

关于AINLP

ainlp shiyigeyouquyouaideziranyuyanchulishequ,zhuanzhuyu ai、nlp、jiqixuexi、shenduxuexi、tuijiansuanfadengxiangguanjishudefenxiang,zhutibaokuowenbenzhaiyao、zhinengwenda、liaotianjiqiren、jiqifanyi、zidongshengcheng、zhishitupu、yuxunlianmoxing、tuijianxitong、jisuanguanggao、zhaopinxinxi、qiuzhijingyanfenxiangdeng,huanyingguanzhu!jiajishujiaoliuqunqingtianjiaainlpjunweixin(id:ainlp2),beizhugongzuo/yanjiufangxiang+jiaqunmude。

征稿启示| 让更多的NLPer看到你的文章

AINLP

3d和值振幅连线走势图renzhendejiainlpgongzhonghaozhenggegao,zhiqianzaiainlpjishujiaoliuqunfenxiangguo,xianzaixiwanggengduoyoujishuxiezuoxiguandetongxuekandao。

ruguonipingshiyouxiejishuwenzhangdexiguanbingqieyuanyifenxiangjigengduonlperkandao,wenzhangyijingfabuhuozhejihuafabuzainigerendehulianwangshangderenhedifang,piruduliboke、zhihuzhuanlan、github、geleibokepingtai,huanyingtougaojiainlpgongzhonghao,ziranyuyanchuli、jiqixuexi、shenduxuexixiangguanjike,womenhuizuochubudepanduanshifouheshi。

ruguookbingqieshouquanainlpgongzhonghaoyuanchuangbiaozhi,womenyuanyijiyuyixiewuzhiganxie,baokuobaiyuangaofei(huodengjiashuji)+ jiazhi20gexiaoshi1080tidegpuyunsuanli(yekeyishiyongqitajiqiliru2080huozhe2080tisuanli)+zhishixingqiu"ainlpzhimajie"dejiabinshenfen。

ruguobushouquanainlpgongzhonghaoyuanchuangbiaozhi,zhishixiwangnengfenxiangjigengduoderen,yetongyanghuanying,baokuohuozhebuxianyuyijingfabuzaigerengongzhonghaodenlp3dhezhizhenfulianxianzoushituxiangguandewenzhang,qitadifangdejishuwenzhang,githubgerenxiangguanxiangmu,huanyingzijian,womenanzhuanzaimoshijinxingcaozuo。

3d和值振幅连线走势图guanyuyuanchuangbiaozhi,zheishigongzhonghaobaohujishuyuanchuangwenzhangdeyigehenhaodemoshi,xingshishangjiushizaizuozheqianjiageyuanchuang,liru:

guanyuainlpdegpuyunfuwu,qingcankao:

guanyuainlpzhimajie,qingcankao:

zuihou,changhuanyingdajialaitougao,dangran,womenyefeichanggulidajiajinxingjishuxiezuo,xiezuonenglishichengxuzhiwaifeichangbangdeyigeruanjineng。

guanyuainlp

ainlp shiyigeyouquyouaideziranyuyanchulishequ,zhuanzhuyu ai、nlp、jiqixuexi、shenduxuexi、tuijiansuanfadengxiangguanjishudefenxiang,zhutibaokuowenbenzhaiyao、zhinengwenda、liaotianjiqiren、jiqifanyi、zidongshengcheng、zhishitupu、yuxunlianmoxing、tuijianxitong、jisuanguanggao、zhaopinxinxi、qiuzhijingyanfenxiangdeng,huanyingguanzhu!jiajishujiaoliuqunqingtianjiaainlpjunweixin(id:ainlp2),beizhugongzuo/yanjiufangxiang+jiaqunmude。

AINLP公众号新增"彩虹屁生成器"

AINLP

zuijinfaxianbushaotongxuetongguosousuocaihongpi,caihongpishengchengqizhaoguolai,feihuabuduoshuo,qingguanzhuainlpgongzhonghao,zhijieduihuabaohan“caihongpi”sangezijikesuijichucaihongpi:

====================================================================

qianjitian,kandaoleyitiaohenyouyisideweibo:

zhenglileyixiezidongshengchengqi,wuliaodeshihoukeyiwaneryitian

‣ madingludemarenshengchengqi,shoujiletazuopinlisuoyoudezanghua,lianchuchudouyou。dianjijikeganshouruma

‣ goupibutongwenzhangshengchengqi,xiegaobibei

‣ caihongpishengchengqi,kuarennanshouke🐎zhu

‣ teshuzitishengchengqi,keyijiangwenzishengchengqitayouquziti

‣ nuojiyaduanxintupianshengchengqi:

‣ jichoubiaoqingbaoshengchengqi:

‣ aidoufanpaishengchengqi:

‣ yanwenzishengchengqi:

3d和值振幅连线走势图‣ bgmzidongshengchengqi:

‣ marenbaodianshengchengqi:

‣ zaixianbiaoqingbaozhizuoqi:

‣ zangtoushishengchengqi:

3d和值振幅连线走势图‣ cpduandashengchengqi,wojiumeidakaiguo...nimenkeyishishi

3d和值振幅连线走势图yinweizuijinxihuanjiainlpgongzhonghaohoutai(duihua)jiayixiexiaodongxi,suoyijiuyigeyigedeshileyixia,kankanyoumeiyoukenengjiadaoainlpgongzhonghaohoutaide,zuihousuoding“caihongpishengchengqi”。buguozaizheizhiqian,teyisouleyixiashenmeshicaihongpi,yixialaizibaidubaikedejieshi:

3d和值振幅连线走势图caihongpi,wangluoliuxingyu,fanquanchangyongyu,zuizaoliuxingqilaideshijianshizai2017nian。yisiweifensimenhuashichuipengzijideouxiang,hunshenshibao,quanshiyoudian,zimianyisiweijiulianouxiangfangpidounengbatachukouchengzhangmianbugaisedechuichengshicaihong。

词语来源:
该词最早出自于2017年的追星女孩,也就是所谓的饭圈,堪称是追星女孩的必备素养。

发展经过:
3d和值振幅连线走势图 该词在2017年就火了,由于《镇魂》这部网络剧,又一次火了,而且还做出了很多各式各样的表情包。就好比要夸一个人,但是没有词汇去夸,那么“彩虹屁”就是一个非常棒的替代词。

引用示例
该词就是模仿韩国的用语,用词语气非常的夸张,常见的饭圈用语,就是说偶像放一个屁,就能比喻成彩虹。追星女孩她们眼中的偶像是非常棒的,所以怎么看都是好的。

3d和值振幅连线走势图shangmianweibotidaodegongjulimianjichoubiaoqingbaoshengchengqi、caihongpishengchengqi、marenbaodianshengchengqiyou  zhizuo ,wozaidiaoyanguochengfaxianzuozhetigongapijiekou,suoyijiusixinwenleyixiashouquan,@zhibodianba henkeqi,rangwofayoujianji jiukeyile,suoyifalefengyoujian,zuozhehuifuhenxunsu,jishezhilelaiyuanbaimingdan,bingqiehaijilewoyifenlaiyuanyuwangyoudecaihongpishuju,liru:

弱水三千我只取一瓢,你就是那个瓢
想把今天的白云寄给你,想把今天的皑皑白雪寄给你,想把我寄给你。
如果你来了 春天就可以 不用来了
我算不上低调 但也不喜欢炫耀 却想让每个认识我的人都知道你。
你就像⻜机、火车一样;你晚了,我等你;我晚了,你就⾛了。
螃蟹在剥我的壳,笔记本在写我;漫天的我落在枫叶雪花上;而你在想我。
如果你的⼀⽣需要有⼈捧在手上 那个⼈只能是我 必须是我
喜欢看你认真的样⼦,喜欢听你的声⾳,忍不住想要永远拥有你的微笑~
关于想你这件事 躲得过⼈潮汹涌的街 却躲不过四下⽆⼈的夜
3d和值振幅连线走势图 在这什么都善变的⼈间 我想陪你一起看一看这永远有多远

youlezheixietiaojian,jiukeyihenkuaidejiainlptianjia"caihongpishengchengqi"gongnengle,ganxingqudetongxuekeyizhijietongguoainlpgongzhonghaoceshi,zhiyaowenjuzhongbaohan“caihongpi”sangezijike:

benlaixianghekuakualiaotianjiqirenfangzaiyiqide,danshiduzhemaosibushikuarendeganjue,suoyizuizhonghaishidanduchulile,ganxingqudetongxuekeyiguanzhuainlpgongzhonghao,houtaiduihuazhijieceshi:

注:原创文章,转载请注明出处及保留链接“我爱自然语言处理”:http://pfyc982.cn

本文链接地址:AINLP公众号新增"彩虹屁生成器" http://pfyc982.cn/?p=12419