如何在腾讯云上部署 Facebook 的ParlAI 训练框架

刚看到腾云阁新一期的活动又开始了,跃跃欲试,恰巧看到ParlAI我就把安装过程记录一下。

必备环境:

代码语言:txt
复制
python3

ZeroMq

安装命令:

代码语言:txt
复制
git clone https://github.com/facebookresearch/ParlAI.git
cd ParlAI
python setup.py develop

安装过程中问题一:

代码语言:txt
复制
UnicodeDecodeError: 'gbk' codec can't decode byte 0x9d in position 1270: illega
解决方法:我把setup.py代码稍加修改了。 都是utf-8的 我这里很疑惑
去掉:
with open('LICENSE') as f:
license = f.read()

with open('requirements.txt') as f:
reqs = f.read()
初始化:
license='',
long_description='',

问题二:

代码语言:txt
复制
“error: Microsoft Visual C++ 14.0 is required..
解决办法:

手工安装

pip install pyzmq

问题三:

代码语言:txt
复制
AttributeError: module 'parlai.tasks.babi.agents' has no attribute 'create_agents'
TimeoutError: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没
有反应,连接尝试失败。
解决办法:
安装ZeroMq

运行案例:

代码语言:txt
复制
F:\py\parlai\ParlAI>python examples/display_data.py -t babi:task1k:1
[no_images:False]
[download_path:f:\py\parlai\parlai\downloads]
[task:babi:task1k:1]
[datatype:train]
[batchsize:1]
[num_examples:10]
[numthreads:1]
[parlai_home:f:\py\parlai\parlai]
[datapath:f:\py\parlai\parlai\data]
[creating task(s): babi:task1k:1]
[building data: f:\py\parlai\parlai\data\bAbI]
100% [....................................................] 19212062 / 19212062
unpacking babi.tar.gz
[DialogTeacher initializing.]
[loading fbdialog data:f:\py\parlai\parlai\data\bAbI\tasks_1-20_v1-2\en-valid-n
sf\qa1_train.txt]
[babi:task1k:1]: Mary travelled to the garden.
Daniel went to the office.
Where is Daniel?
[labels: office]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: office
~~
[babi:task1k:1]: Daniel travelled to the kitchen.
Sandra journeyed to the kitchen.
Where is Daniel?
[labels: kitchen]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: kitchen
~~
[babi:task1k:1]: Mary went back to the hallway.
Daniel went to the bedroom.
Where is Daniel?
[labels: bedroom]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: bedroom
~~
[babi:task1k:1]: Mary moved to the bathroom.
Sandra journeyed to the bathroom.
Where is Mary?
[labels: bathroom]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: bathroom
~~
[babi:task1k:1]: John journeyed to the garden.
Sandra went to the garden.
Where is Sandra?
[labels: garden]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: garden


~~
[babi:task1k:1]: Mary travelled to the bedroom.
Daniel travelled to the office.
Where is Mary?
[labels: bedroom]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: bedroom
~~
[babi:task1k:1]: Daniel journeyed to the hallway.
Mary travelled to the hallway.
Where is Mary?
[labels: hallway]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: hallway
~~
[babi:task1k:1]: Sandra travelled to the kitchen.
Mary travelled to the kitchen.
Where is Daniel?
[labels: hallway]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: hallway
~~
[babi:task1k:1]: John journeyed to the garden.
Daniel went to the bathroom.
Where is Sandra?
[labels: kitchen]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: kitchen
~~
[babi:task1k:1]: Daniel moved to the garden.
John went to the kitchen.
Where is Daniel?
[labels: garden]
[cands: garden|kitchen|office|bedroom|bathroom|hallway]
[RepeatLabelAgent]: garden


~~