Scrapy的错误。

641693535

运行报错。
报错的信息：

1. 2018-12-24 15:44:42 [scrapy.core.scraper] ERROR: Spider error processing <GET http://poxiao.com/movie/10002.html via http://localhost:8050/render.html> (referer: None)
   
2. Traceback (most recent call last):
   
3.   File "e:\python\lib\site-packages\twisted\internet\defer.py", line 654, in _runCallbacks
   
4.     current.result = callback(current.result, *args, **kw)
   
5.   File "E:\movie\movie\spiders\poxiao.py", line 30, in parse
   
6.     iss = FormRequest.from_response('http://192.168.83.81/1/1.html',formdata=self.fd,callback=self.movie_save)
   
7.   File "e:\python\lib\site-packages\scrapy\http\request\form.py", line 42, in from_response
   
8.     kwargs.setdefault('encoding', response.encoding)
   
9. AttributeError: 'str' object has no attribute 'encoding'

复制代码

运行的代码：

1. # -*- coding: utf-8 -*-
   
2. import scrapy
   
3. from scrapy_splash import SplashRequest
   
4. import time
   
5. from scrapy.http import FormRequest,Request
   
6. class PoxiaoSpider(scrapy.Spider):
   
7.     name = 'poxiao'
   
8.     start_urls = ['http://poxiao.com/']
   
9.     fd = {}
   
10. 
    
11.     def start_requests(self):
    
12.         for number in range(10000,10005):
    
13.             for start_url in self.start_urls:
    
14.                 url = str(start_url)+'movie/'+str(number)+'.html'
    
15.                 time.sleep(1)
    
16.                 yield SplashRequest(url,args={'images':0,'timeout':3})
    
17. 
    
18.     def parse(self, response):
    
19.         name = (response.css('div#film h1::text').extract_first())
    
20.         down = []
    
21.         for downlink in response.css('div.resourcesmain tr'):
    
22.             downl = downlink.css('td.sebc3 a::attr(href)').extract_first()
    
23.             down.append(downl)
    
24.         if down.count(None):down.pop()
    
25.         self.fd = {'wz':response.url,
    
26.                   'bt':name,
    
27.                   'picture':'None',
    
28.                   'xzll':down,}
    
29. ##        yield Request('http://192.168.83.81/1/1.html')
    
30.         yield FormRequest.from_response('http://192.168.83.81/1/1.html',formdata=self.fd,callback=self.movie_save)
    
31.     def movie_save(self,response):
    
32.         yield from super().start_requests()
    
33. ##            yield{'url':response.url,
    
34. ##                  'name':name,
    
35. ##                  'down':down,}
    

复制代码

小强工作室

你爬取url=https://www.poxiao.com/ 能把项目需求写一下吗？