Commit Graph

55 Commits

Author SHA1 Message Date
James Turk
4e860f7b44 add an index on tracked._random 2011-09-21 18:27:35 -04:00
James Turk
1047ca8927 default timeout and return tracked _id 2011-09-21 17:00:06 -04:00
James Turk
28450782ee import re first 2011-09-21 15:34:53 -04:00
James Turk
d5aac2323f _path_fixer for :// collapsing to :/ 2011-09-21 15:33:30 -04:00
James Turk
0f0a7b838f non-absolute path for media 2011-09-21 12:05:23 -04:00
James Turk
31d308f0e1 bump to 0.2.1 2011-09-20 17:15:36 -04:00
James Turk
448dee151b change description 2011-09-20 17:15:15 -04:00
James Turk
1067bfcdc4 setup.py 2011-09-20 16:31:22 -04:00
James Turk
ab467d9d05 bump version to 0.2.0 2011-09-20 16:16:55 -04:00
James Turk
376d27a8ff 3 retry_attempts and a default 5 minute timeout 2011-09-20 16:07:24 -04:00
James Turk
c31faa3fb7 revert default retry_wait_minutes 2011-09-20 14:55:17 -04:00
James Turk
5da67c03da change how retries work 2011-09-20 14:51:36 -04:00
James Turk
dd622ab250 have celery settings rely on oyster settings 2011-09-20 11:43:44 -04:00
James Turk
67efb9b681 fix for celery tasks to use configured client 2011-09-20 11:01:58 -04:00
James Turk
c93a8d7b3b replace oysterd with celery 2011-08-05 19:09:33 -04:00
James Turk
47d094e919 use configured client 2011-08-05 19:08:01 -04:00
James Turk
67cc05078e separate tests from real db 2011-08-05 19:03:52 -04:00
James Turk
1357b55be6 gitignore 2011-08-05 16:47:08 -04:00
James Turk
1b3330fa69 fix how status is checked to avoid piling-on 2011-08-05 16:46:13 -04:00
James Turk
415dc44af2 celery tasks replacing oysterd 2011-08-05 15:32:44 -04:00
James Turk
7d8f13ba73 getting close to 0.1 functionality 2011-08-05 13:16:34 -04:00
James Turk
548f755a6e date formatting tweak 2011-08-04 22:48:33 -04:00
James Turk
ffacdabb4e index 2011-08-04 22:11:14 -04:00
James Turk
512a5f8e55 get_update_queue_size now uses counts 2011-08-04 15:35:16 -04:00
James Turk
d9d63e1660 no need for max arg on get_update_queue anymore 2011-08-04 15:29:59 -04:00
James Turk
6cbbf47c4a flask & nose required 2011-08-04 15:27:59 -04:00
James Turk
efd2ae2393 test all_versions & get_update_queue 2011-08-04 15:24:56 -04:00
James Turk
34bf9acd56 flesh out update tests 2011-08-04 15:02:02 -04:00
James Turk
3c5b47c08e LICENSE 2011-08-04 11:40:37 -04:00
James Turk
f05968f01d more tests 2011-08-03 12:14:02 -04:00
James Turk
5cd16a4e04 some basic tests 2011-08-02 23:40:55 -04:00
James Turk
c2a60aea94 api_wrapper 2011-08-02 18:33:36 -04:00
James Turk
f6072cdb9b coloring for errors 2011-08-02 18:08:01 -04:00
James Turk
29ac3b0fb7 make logs look nice 2011-08-02 17:57:42 -04:00
James Turk
c14363ba38 all created clients in oysterd should obey settings 2011-08-02 16:18:26 -04:00
James Turk
f5e463e366 fix to oysterd config 2011-08-02 16:12:05 -04:00
James Turk
71afc7074b we don't need a shell for now 2011-08-02 14:56:53 -04:00
James Turk
1573043237 oysterd configurability 2011-08-02 14:47:19 -04:00
James Turk
96ccea0f1e tracked JSON view 2011-08-02 14:04:41 -04:00
James Turk
482a0ea1ae logging improvements, tracked view 2011-08-01 16:48:36 -04:00
James Turk
b1d9151b08 fix to double-stacking queue problem and string-ize exceptions 2011-08-01 15:02:47 -04:00
James Turk
fc1a311615 basic logging 2011-08-01 13:56:37 -04:00
James Turk
08aef40662 working dual webserver/daemon 2011-07-29 16:53:29 -04:00
James Turk
db718d3190 oysterd 2011-07-29 13:04:44 -04:00
James Turk
81ef0e71f0 set content-type to mimetype 2011-07-29 10:16:45 -04:00
James Turk
0a2b3bfae7 temporary fix to urllib quote issue 2011-07-28 19:03:07 -04:00
James Turk
fd9d6ebb64 beginning of flask app 2011-07-28 18:48:20 -04:00
James Turk
2342b4aeef error handling 2011-07-28 18:48:10 -04:00
James Turk
b7ab8d0ce4 fix to urlopen call 2011-07-28 16:56:59 -04:00
James Turk
bc8438a106 scrapelib config options 2011-07-28 16:20:30 -04:00