jpt-archive/oyster
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • ac5bf809da S3 storage James Turk 2012-02-14 17:24:55 -0500
  • d66ebdd74a major core refactor, shift to how storage is done James Turk 2012-02-14 16:42:41 -0500
  • d1101a2949 fix kernel update_queue task James Turk 2012-02-13 18:48:54 -0500
  • 87462beaf5 requirements James Turk 2012-02-13 18:39:03 -0500
  • c65cde6bbd design braindump James Turk 2012-02-13 18:35:58 -0500
  • e73ec6ab6b switch to Kernel James Turk 2012-02-13 18:33:41 -0500
  • f6a85c119b clarify newdata in update James Turk 2012-02-13 17:43:24 -0500
  • 3539e50c9d rename client to connection James Turk 2012-02-13 14:34:45 -0500
  • 7526280333 tag as 0.2.5 0.2.5 James Turk 2012-02-12 18:17:08 -0500
  • 00c3fd59f4 set CELERY_CONFIG_MODULE James Turk 2011-10-06 10:32:14 -0400
  • 979775ac72 pass metadata to extract_text James Turk 2011-10-05 15:57:32 -0400
  • 27a338abf5 fix for extract_text usage James Turk 2011-10-05 15:55:48 -0400
  • 5b71fa4aea ExternalStoreTask takes an extract_text argument James Turk 2011-10-05 15:52:16 -0400
  • e6c9cd6a06 pass a string as filedata in ExternalStoreTask James Turk 2011-10-04 12:46:32 -0400
  • d3ed585a8c CELERY_TASK_MODULES oyster setting James Turk 2011-10-03 16:01:29 -0400
  • f6282c8040 oyster_settings to .gitignore James Turk 2011-10-03 15:47:28 -0400
  • 8ec1f12610 ExternalStore and S3 tasks James Turk 2011-10-03 15:47:04 -0400
  • f8f66c82f9 update ever 2s James Turk 2011-09-30 17:19:41 -0400
  • 7c8363056d fix json request to use script root James Turk 2011-09-30 17:18:49 -0400
  • 5247350524 front page updates as it runs James Turk 2011-09-28 17:50:03 -0400
  • 51480fafcc track_url with same parameters returns original id James Turk 2011-09-28 15:50:32 -0400
  • da1a3385e1 fix failing tests that didn't work with error code James Turk 2011-09-28 15:43:53 -0400
  • 7b8eda5143 Revert "restore limit arg" James Turk 2011-09-27 18:11:46 -0400
  • d7de2f762c restore limit arg James Turk 2011-09-27 18:09:29 -0400
  • d1df737474 use MONGO_ settings for broker James Turk 2011-09-27 17:24:47 -0400
  • cad6ceb4f7 Revert "update tracked view to take id instead of URL" James Turk 2011-09-22 13:28:57 -0400
  • eefc74815e Revert "mongo wants ObjectIds" James Turk 2011-09-22 13:28:50 -0400
  • 5b85dfa4e5 mongo wants ObjectIds James Turk 2011-09-22 12:57:18 -0400
  • f2c2e2d6f2 update tracked view to take id instead of URL James Turk 2011-09-22 12:52:01 -0400
  • 4174a25595 script_root to absolute URLs James Turk 2011-09-22 10:53:33 -0400
  • 84c9c105fd syntax error due to laziness James Turk 2011-09-21 18:51:19 -0400
  • d87a702bfe mongo_host on index James Turk 2011-09-21 18:49:11 -0400
  • 4e860f7b44 add an index on tracked._random James Turk 2011-09-21 18:27:35 -0400
  • 1047ca8927 default timeout and return tracked _id James Turk 2011-09-21 17:00:06 -0400
  • 28450782ee import re first James Turk 2011-09-21 15:34:53 -0400
  • d5aac2323f _path_fixer for :// collapsing to :/ James Turk 2011-09-21 15:33:30 -0400
  • 0f0a7b838f non-absolute path for media James Turk 2011-09-21 12:05:23 -0400
  • 31d308f0e1 bump to 0.2.1 James Turk 2011-09-20 17:15:36 -0400
  • 448dee151b change description James Turk 2011-09-20 17:15:15 -0400
  • 1067bfcdc4 setup.py 0.2.0 James Turk 2011-09-20 16:31:22 -0400
  • ab467d9d05 bump version to 0.2.0 James Turk 2011-09-20 16:16:55 -0400
  • 376d27a8ff 3 retry_attempts and a default 5 minute timeout James Turk 2011-09-20 16:07:24 -0400
  • c31faa3fb7 revert default retry_wait_minutes James Turk 2011-09-20 14:55:17 -0400
  • 5da67c03da change how retries work James Turk 2011-09-20 14:51:36 -0400
  • dd622ab250 have celery settings rely on oyster settings James Turk 2011-09-20 11:43:44 -0400
  • 67efb9b681 fix for celery tasks to use configured client James Turk 2011-09-20 11:01:58 -0400
  • c93a8d7b3b replace oysterd with celery James Turk 2011-08-05 19:09:33 -0400
  • 47d094e919 use configured client James Turk 2011-08-05 19:08:01 -0400
  • 67cc05078e separate tests from real db James Turk 2011-08-05 19:03:52 -0400
  • 1357b55be6 gitignore James Turk 2011-08-05 16:47:08 -0400
  • 1b3330fa69 fix how status is checked to avoid piling-on James Turk 2011-08-05 16:46:13 -0400
  • 415dc44af2 celery tasks replacing oysterd James Turk 2011-08-05 15:32:44 -0400
  • 7d8f13ba73 getting close to 0.1 functionality 0.1 James Turk 2011-08-05 13:16:34 -0400
  • 548f755a6e date formatting tweak James Turk 2011-08-04 22:48:33 -0400
  • ffacdabb4e index James Turk 2011-08-04 22:11:14 -0400
  • 512a5f8e55 get_update_queue_size now uses counts James Turk 2011-08-04 15:35:16 -0400
  • d9d63e1660 no need for max arg on get_update_queue anymore James Turk 2011-08-04 15:29:59 -0400
  • 6cbbf47c4a flask & nose required James Turk 2011-08-04 15:27:59 -0400
  • efd2ae2393 test all_versions & get_update_queue James Turk 2011-08-04 15:24:56 -0400
  • 34bf9acd56 flesh out update tests James Turk 2011-08-04 15:02:02 -0400
  • 3c5b47c08e LICENSE James Turk 2011-08-04 11:40:37 -0400
  • f05968f01d more tests James Turk 2011-08-03 12:14:02 -0400
  • 5cd16a4e04 some basic tests James Turk 2011-08-02 23:40:55 -0400
  • c2a60aea94 api_wrapper James Turk 2011-08-02 18:33:36 -0400
  • f6072cdb9b coloring for errors James Turk 2011-08-02 18:08:01 -0400
  • 29ac3b0fb7 make logs look nice James Turk 2011-08-02 17:57:42 -0400
  • c14363ba38 all created clients in oysterd should obey settings James Turk 2011-08-02 16:18:26 -0400
  • f5e463e366 fix to oysterd config James Turk 2011-08-02 16:12:05 -0400
  • 71afc7074b we don't need a shell for now James Turk 2011-08-02 14:56:53 -0400
  • 1573043237 oysterd configurability James Turk 2011-08-02 14:47:19 -0400
  • 96ccea0f1e tracked JSON view James Turk 2011-08-02 14:04:41 -0400
  • 482a0ea1ae logging improvements, tracked view James Turk 2011-08-01 16:48:36 -0400
  • b1d9151b08 fix to double-stacking queue problem and string-ize exceptions James Turk 2011-08-01 15:02:47 -0400
  • fc1a311615 basic logging James Turk 2011-08-01 13:56:37 -0400
  • 08aef40662 working dual webserver/daemon James Turk 2011-07-29 16:53:29 -0400
  • db718d3190 oysterd James Turk 2011-07-29 13:04:44 -0400
  • 81ef0e71f0 set content-type to mimetype James Turk 2011-07-29 10:16:45 -0400
  • 0a2b3bfae7 temporary fix to urllib quote issue James Turk 2011-07-28 19:03:07 -0400
  • fd9d6ebb64 beginning of flask app James Turk 2011-07-28 18:48:20 -0400
  • 2342b4aeef error handling James Turk 2011-07-28 18:48:10 -0400
  • b7ab8d0ce4 fix to urlopen call James Turk 2011-07-28 16:56:59 -0400
  • bc8438a106 scrapelib config options James Turk 2011-07-28 16:20:30 -0400
  • 454130f5ea move update logic into client, will allow update strategies James Turk 2011-07-28 16:11:32 -0400
  • 4752e0a7ce add requirements.txt James Turk 2011-07-28 15:01:56 -0400
  • f151a4b9b0 restructure files James Turk 2011-07-28 15:01:50 -0400
  • 8499cd9ba9 add README James Turk 2011-07-28 14:47:43 -0400
  • b844f24322 initial commit, working daemon, non-configurable James Turk 2011-07-28 12:12:17 -0400