Support managing Scrapyd servers with https enabled

[leffss]

1. 直接在web管理界面添加scrapyd主机，并且支持有https连接的scrapyd主机
2. 添加中文语言支持
3. 能够配置各种请求的超时时间与重试次数

[my8100]

1. Adding Scrapyd servers via web UI is not an urgent feature as they don't change often. Managing Scrapyd servers with https enabled would be supported in a future release.
2. There is no plan yet to support multi-language.
3. Currently, any network request to Scrapyd servers has a timeout of 60 seconds, and no retrying, though Timer Tasks would retry one time anyway. In general, it seems no need to custom these configs.

[cgleiyucun]

安装完成之后，输入scrapydweb命令，出现这个报错，请问如何解决：

Traceback (most recent call last):
  File "D:\fenxihuanjing\lib\logging\config.py", line 389, in resolve
    self.importer(used)
ModuleNotFoundError: No module named 'flask.logging.wsgi_errors_stream'; 'flask.logging' is not a package

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "D:\fenxihuanjing\lib\logging\config.py", line 562, in configure
    handler = self.configure_handler(handlers[name])
  File "D:\fenxihuanjing\lib\logging\config.py", line 733, in configure_handler
    kwargs = {k: config[k] for k in config if valid_ident(k)}
  File "D:\fenxihuanjing\lib\logging\config.py", line 733, in <dictcomp>
    kwargs = {k: config[k] for k in config if valid_ident(k)}
  File "D:\fenxihuanjing\lib\logging\config.py", line 324, in __getitem__
    return self.convert_with_key(key, value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 290, in convert_with_key
    result = self.configurator.convert(value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 461, in convert
    value = converter(suffix)
  File "D:\fenxihuanjing\lib\logging\config.py", line 400, in ext_convert
    return self.resolve(value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 396, in resolve
    raise v
  File "D:\fenxihuanjing\lib\logging\config.py", line 389, in resolve
    self.importer(used)
ValueError: Cannot resolve 'flask.logging.wsgi_errors_stream': No module named 'flask.logging.wsgi_errors_stream'; 'flask.logging' is not a package

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "run.py", line 11, in <module>
    from scrapydweb import create_app
  File "D:\fenxihuanjing\lib\site-packages\scrapydweb\__init__.py", line 36, in <module>
    'handlers': ['wsgi']
  File "D:\fenxihuanjing\lib\logging\config.py", line 799, in dictConfig
    dictConfigClass(config).configure()
  File "D:\fenxihuanjing\lib\logging\config.py", line 570, in configure
    '%r' % name) from e
ValueError: Unable to configure handler 'wsgi'

[my8100]

@cgleiyucun Try pip install --upgrade flask

[cgleiyucun]

@my8100 very thanks

[cgleiyucun]

file模块下的items功能页面出现这种报错，请问要如何解决？ Oops! Something went wrong. http://127.0.0.1:6800/items/ status_code: 404

No Such Resource

No such child resource.

Tip Click the above link to make sure your Scrapyd server is accessable.

[my8100]

See https://scrapyd.readthedocs.io/en/latest/config.html#items-dir

[cgleiyucun]

thanks

[cgleiyucun]

@my8100 就是说这个页面不用去处理它，一旦启用会覆盖掉scrapy的items设置？

[my8100]

Yes, you can also hide the menu by setting SHOW_SCRAPYD_ITEMS to False.

https://github.com/my8100/scrapydweb/blob/8104386438cb7e18e5b619c53aedf22dc5bb8954/scrapydweb/default_settings.py#L156-L160

[cgleiyucun]

thanks

[MrDHY]

@my8100 do you finished this feature?

[MrDHY]

I love this pro, also I need this ability

[imba-tjd]

The tip is trying to access hard-coded 127.0.0.1:6800

All of the blue link (for example Monitor and control all of your Scrapyd servers.) also have this issue.