Adding support for a database?

[sluceno]

Hi,

I am wondering how it would be seen to add support for postgres or some kind of database. Probably redis is not a bad idea as well.

The idea behind is to be able to scale horizontally, having a shared database among the different scrapyd processes would do the trick.

Thanks

[my8100]

Maybe you could try #359 first and give some feedback?

[sluceno]

thank for your answer.

We will take a look for sure in the near future. Will let you know

[Digenis]

Related: #197

[jpmckinney]

What would be the purpose of the database? As an alternative to the sqlite DB, or for some other purpose?

[jpmckinney]

Closing as no response to question in several months.