Commit Graph

Select branches

Hide Pull Requests

master

scraper

scraper-dev

Mono Color

• ac8aa3418a Merge branch 'scraper' into scraper-dev scraper-dev Tomas 2025-10-09 20:38:07 +02:00
• 3ead328a0f Merge branch 'master' into scraper scraper Tomas 2025-10-09 20:37:55 +02:00
• fb90935d42 Remove non image formats master Tomas 2025-10-09 20:37:39 +02:00
• 889e9b69a8 Remove non image formats Tomas 2025-10-09 20:36:06 +02:00
• 66bef9279f Merge branch 'scraper' into scraper-dev Tomas 2025-10-09 20:07:14 +02:00
• f55f118271 Merge branch 'master' into scraper Tomas 2025-10-09 20:07:02 +02:00
• 3279e8e3c0 Scan video formats aswell Tomas 2025-10-09 20:06:51 +02:00
• 1dc17d7670 Don't create py34.Post for downloading images Tomas 2025-10-09 20:05:36 +02:00
• 97a63937df Merge branch 'scraper' into scraper-dev Tomas 2025-10-09 19:25:28 +02:00
• 9247ab28ce Merge branch 'master' into scraper-dev Tomas 2025-10-09 19:25:17 +02:00
• 6d6e13c231 Merge branch 'master' into scraper Tomas 2025-10-09 19:25:12 +02:00
• 34753bc011 Fix typo Tomas 2025-10-09 19:25:05 +02:00
• 5cedbb2526 Merge branch 'scraper' into scraper-dev Tomas 2025-10-09 19:18:37 +02:00
• a4e3ced8ab Download videos too, prioritize video over image Tomas 2025-10-09 19:18:26 +02:00
• 0b3293eaa8 Merge branch 'master' into scraper Tomas 2025-10-09 19:17:26 +02:00
• f07f2ce32d Removed underscore from VIDEO_FORMATS Tomas 2025-10-09 19:17:11 +02:00
• bf9237750b Merge branch 'scraper' into scraper-dev Tomas 2025-10-03 00:09:36 +02:00
• 5473f92470 Merge branch 'master' into scraper Tomas 2025-10-03 00:09:06 +02:00
• ee4ba5d5f2 Create file after the image was retrieved Tomas 2025-10-02 23:40:33 +02:00
• bc28807aeb Fixed a typo Tomas 2025-10-02 23:36:10 +02:00
• a3dca99a5d Merge branch 'scraper' into scraper-dev Tomas 2025-09-23 12:44:52 +02:00
• 217595fcdd Download and cache images Tomas 2025-09-23 12:44:36 +02:00
• bb7d010694 Merge branch 'scraper' into scraper-dev Tomas 2025-09-23 02:27:13 +02:00
• be6740a24c Added api route for getting raw block Tomas 2025-09-23 02:24:57 +02:00
• ee236445c2 Made single threaded, added back delay Tomas 2025-08-28 21:38:32 +02:00
• 71efaf7c25 Merge branch 'master' into scraper Tomuxs 2025-08-27 19:22:17 +02:00
• 1e8e8e9b40 Sleep causes threads to hang (python internal issue) Tomuxs 2025-08-27 19:22:06 +02:00
• f0efc80fd8 Removed sleeping between service overload attempts. Tomuxs 2025-08-27 19:06:31 +02:00
• 54fc8fc213 Merge branch 'scraper' into scraper-dev Tomuxs 2025-08-27 17:47:59 +02:00
• b81684de19 Merge branch 'master' into scraper Tomuxs 2025-08-27 17:47:50 +02:00
• e7a8dcfcb3 Disambiguate image from video servers Tomuxs 2025-08-27 17:47:42 +02:00
• 64908f298e Added verbosity to requests Tomuxs 2025-08-27 17:10:17 +02:00
• f9fe6af292 Merge branch 'master' into scraper Tomuxs 2025-08-26 18:20:06 +02:00
• 461031aa3a Exit retry loop Tomuxs 2025-08-26 18:19:56 +02:00
• 6d1b1628f1 Merge branch 'master' into scraper Tomuxs 2025-08-26 18:15:14 +02:00
• dd4447f756 Get response not body Tomuxs 2025-08-26 18:15:03 +02:00
• 0143cc3999 Merge branch 'master' into scraper Tomuxs 2025-08-26 18:02:07 +02:00
• a2bb0e38cf Don't die on missing thumbnails Tomuxs 2025-08-26 18:01:53 +02:00
• a39bfcd0b1 Merge branch 'master' into scraper Tomuxs 2025-08-15 19:32:33 +02:00
• 31b7ce76df Fixed invalid function name Tomuxs 2025-08-15 19:32:27 +02:00
• 826c5c3473 Merge branch 'master' into scraper Tomuxs 2025-08-15 19:31:40 +02:00
• 965384c3f2 Fixed invalid function names Tomuxs 2025-08-15 19:31:33 +02:00
• 265ec8d58e Merge branch 'master' into scraper Tomuxs 2025-08-15 19:30:42 +02:00
• 6dddf7985c Fixed missing "self" Tomuxs 2025-08-15 19:30:33 +02:00
• 241bc90e82 Merge branch 'master' into scraper Tomuxs 2025-08-15 19:28:08 +02:00
• 081efaeb9f Added more http methods to scraper Tomuxs 2025-08-15 19:27:21 +02:00
• bdf77b2920 Merge remote-tracking branch 'refs/remotes/origin/scraper' into scraper Tomuxs 2025-08-15 18:48:23 +02:00
• 5f4358a3d1 Probe with HEAD requests, not GET Tomuxs 2025-08-15 18:47:58 +02:00
• 8e3a7b105a Fixed invalid extension check Tomas 2025-08-10 15:50:40 +02:00
• d0dec584a8 Removed debug print Tomas 2025-08-10 15:49:03 +02:00
• fb06339cc7 Added flask Tomas 2025-08-10 15:26:14 +02:00
• 48d17fcf7b Merge branch 'master' into scraper Tomas 2025-08-09 17:23:49 +02:00
• c1b8be46aa Initial scraper commit Tomuxs 2025-08-09 17:15:20 +02:00
• 6fc820b397 Added ListURL Tomuxs 2025-08-09 17:12:56 +02:00
• 68b6a505c1 Close handle when deleted Tomuxs 2025-08-09 17:00:56 +02:00
• 462d24ab5e Ignore removed posts Tomuxs 2025-08-09 17:00:38 +02:00
• abdcef0a80 Fixed handle leak Tomuxs 2025-08-09 16:13:25 +02:00
• a0e38071d8 When bot detection kicks in, timeout and reload CloudScraper Tomuxs 2025-08-09 05:12:15 +02:00
• 12038f9477 Fixed view identification Tomuxs 2025-08-09 04:31:37 +02:00
• dddb0e9583 Fixed handle leak Tomuxs 2025-08-09 04:25:24 +02:00
• c9928342c2 Added ViewURL Tomuxs 2025-08-09 04:24:37 +02:00
• 14ed66aad7 Added empty Post constructor Tomuxs 2025-08-09 04:24:16 +02:00
• 8f228bde36 Close response handles Tomuxs 2025-08-09 02:27:23 +02:00
• 7ca4c4bfac Added scraper.reset Tomuxs 2025-08-09 02:25:50 +02:00
• 8fa6e2cce4 Made urls consistent Tomuxs 2025-08-09 02:06:04 +02:00
• e4814f8a37 Added is_view check, fixed exception constructors, added sample image Tomuxs 2025-08-09 02:04:45 +02:00
• f879535b25 Samples are always JPG Tomuxs 2025-08-09 01:07:29 +02:00
• 41ecfaec90 Added SampleURL Tomuxs 2025-08-08 23:40:23 +02:00
• 435fcd2fc3 Add "is None" checks, instead of infering Tomuxs 2025-08-08 06:01:20 +02:00
• 3831b95161 Changed to ThreadPoolExecutor Tomuxs 2025-08-06 04:35:18 +02:00
• 6834a2d056 Retry if received captcha Tomuxs 2025-08-04 14:58:07 +02:00
• 8dd0b576a2 Removed empty "tags" Tomuxs 2025-08-04 14:40:38 +02:00
• d112ea4ce9 Added threadpool Tomuxs 2025-08-04 14:34:04 +02:00
• 1cc617aeda Check for invalid posts Tomuxs 2025-08-02 23:23:21 +02:00
• bebb39e722 Reoredered formats Tomuxs 2025-08-02 23:23:02 +02:00
• 38e081a741 Move list of known extensions to py34.url Tomuxs 2025-08-02 15:42:08 +02:00
• 1653e8db7c Allow requesting without downloading Tomuxs 2025-08-02 15:41:50 +02:00
• 3372af33c4 Modified how post thumbnails are handled Tomuxs 2025-08-02 03:46:33 +02:00
• 9726a3018e Enforced variable types Tomuxs 2025-08-02 03:14:38 +02:00
• 7ad8b14fdc Improved URL Handling, Added View to Post convertion Tomuxs 2025-08-01 23:38:20 +02:00
• 317d81f995 Improved URL handling Tomuxs 2025-08-01 15:12:50 +02:00
• 56fdad7fd4 Added .editorconfig Tomuxs 2025-08-01 05:16:49 +02:00
• 9db30c0194 Removed todo.txt Tomuxs 2025-08-01 05:01:15 +02:00
• 013a3b8e35 Cleaned .gitignore Tomuxs 2025-08-01 04:59:31 +02:00
• c64c4225ff Implemented everything, removed scraper Tomuxs 2025-08-01 04:52:27 +02:00
• 4a632d146a Reorganized the project Tomuxs 2025-07-30 13:07:01 +02:00
• 42d31a68c4 Fixed imports, tags Tomas 2025-07-30 11:02:52 +02:00
• 46f7d3a27d Initial commit Tomuxs 2025-07-26 22:52:02 +02:00