You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have 7 servers with running scrapyd.
Repo clones to the first server and the deployed to another 6 servers.
Already on 'master'
From github.com:....
e51238d...82cb8 master -> origin/master
Updating e51238d..82cb8
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server1:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": "27-01-2014-3012-ged82cb8", "spiders": 1893}
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server2:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": 27-01-2014-3012-ged82cb8"", "spiders": 1893}
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server3:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": "27-01-2014-3012-ged82cb8", "spiders": 1893}
But when I start the spiders with scrapyd at different servers I receive the different results. Some old code still remains at scrapyd.
Despite the versions at spiders are the same:
user@server1:~/de-scrapy$ curl http://localhost:6800/listversions.json?project
...
I tried to restart scrapyd service but this doesn't help.
Only one working solution was to delete project at each server and create it from scratch. But this doesn't guarantee that problem can't occur again.
Please help with fixing this.
Thanks!
The text was updated successfully, but these errors were encountered:
I'm not sure because I checked the versions at servers and they were the same as on server1 (where spiders works well).
Is scrapyd can choose different versions for different spiders?
We have 7 servers with running scrapyd.
Repo clones to the first server and the deployed to another 6 servers.
Already on 'master'
From github.com:....
e51238d...82cb8 master -> origin/master
Updating e51238d..82cb8
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server1:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": "27-01-2014-3012-ged82cb8", "spiders": 1893}
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server2:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": 27-01-2014-3012-ged82cb8"", "spiders": 1893}
Packing version 27-01-2014-3012-ged82cb8
Deploying to project "1" in http://server3:6800/addversion.json
Server response (200):
{"status": "ok", "project": "1", "version": "27-01-2014-3012-ged82cb8", "spiders": 1893}
But when I start the spiders with scrapyd at different servers I receive the different results. Some old code still remains at scrapyd.
Despite the versions at spiders are the same:
user@server1:~/de-scrapy$ curl http://localhost:6800/listversions.json?project
...
{"status": "ok", "versions": ["27-01-2014-3012-ged82cb8-master",...
user@server6:~$ curl http://localhost:6800/listversions.json?project=1
{"status": "ok", "versions": ["27-01-2014-3012-ged82cb8-master",...
I tried to restart scrapyd service but this doesn't help.
Only one working solution was to delete project at each server and create it from scratch. But this doesn't guarantee that problem can't occur again.
Please help with fixing this.
Thanks!
The text was updated successfully, but these errors were encountered: