28 Commits
Author SHA1 Message Date
clchen 96b5128eb2 add puppeteer fetcher 2019-02-14 17:10:54 +08:00
binux 124b9f2b6a fix docker build 2017-03-05 23:32:22 +00:00
Kuan Huang 0d197db65a change dockerfile mysql-connector-python curl 2017-01-17 01:17:25 +08:00
binux 0d0c9d6891 fix docker build
pool mysql-Connector! https://bugs.mysql.com/bug.php?id=79766
2016-05-24 22:22:23 +01:00
VicYu 75ff368d25 Update Dockerfile about new version mysql connector
Update Dockerfile about new version mysql connector
2016-04-15 14:42:21 +08:00
binux ac672c695e revert git pull, doesn't work! 2016-04-06 20:09:46 +01:00
binux d973cc2142 git pull to make sure the code in docker is up to data 2016-04-05 22:13:21 +01:00
binux f8c889a8c4 fix docker build 2016-01-21 21:54:54 +00:00
binux 583dfd1616 add postgresql support to docker, try catch for postgresql 2015-09-29 20:56:40 +01:00
binux 3601753e9e fix Docerfile 2015-06-04 11:51:22 +08:00
binux 617c94b86c add easywebdav for test 2015-06-04 10:37:05 +08:00
binux 41f55d75a4 use mysqldb in docker 2015-05-27 15:26:01 +08:00
binux 2863e2cd1f Revert "use mysqldb in docker"
This reverts commit cd1aab3f97.
2015-05-25 00:08:00 +08:00
binux cd1aab3f97 use mysqldb in docker 2015-05-24 21:35:52 +08:00
binux df73747b2d fix for docker deployment 2015-04-11 17:51:51 +08:00
binux 234c569cbf fix docker again? 2015-04-11 16:36:45 +08:00
binux 6f8a9e5739 fix for ubuntu 12.04 2015-04-11 16:19:41 +08:00
binux 28069386ef restart phantomjs if crash, it's a workaround of #175
build docker with phantomjs image to support pyspider phantomjs command
2015-04-11 15:37:03 +08:00
binux efc6c20078 change docker base image to offical ubuntu 2015-03-25 21:46:52 +08:00
binux 6b02ed527b add one mode for result worker, writing results to stdout
fix Dockerfile
fix quit_interactive will quit_pyspider when not crawl request
2015-01-20 23:30:17 +08:00
binux 1e0f12c7ba fix docker file 2015-01-01 10:50:17 +08:00
binux 1f850541d3 fix phantomjs keep-alive bug
add processed new task cache when check new tasks. not process new
request twice for perform.
update dockerfile set pyspider as volumn for debug
fix bug in tornado_fetcher when using async mode
debugger load fetch options from old task
2014-10-31 22:45:36 +08:00
binux 7a82e3d875 add phantomjs to run.py
add logs for phantomjs_fetcher
update README
fix timeout error message for tornado fetcher proxy to phantomjs fetcher
run test exit with right exit code when test is failed
2014-10-31 20:25:37 +08:00
binux f8702f2927 a better docker file 2014-10-22 23:23:25 +08:00
binux 73e47e8317 fix docker 2014-10-17 01:09:20 +08:00
binux d9233ef785 docker fix 2014-10-12 14:43:39 +08:00
binux a4c089d285 add mongodb.taskdb 2014-10-12 12:17:48 +08:00
binux 75d45c8333 active tasks for each project 2014-10-09 22:58:47 +08:00