49 Commits

Author SHA1 Message Date
fb90935d42 Remove non image formats 2025-10-09 20:37:39 +02:00
3279e8e3c0 Scan video formats aswell 2025-10-09 20:06:51 +02:00
34753bc011 Fix typo 2025-10-09 19:25:05 +02:00
f07f2ce32d Removed underscore from VIDEO_FORMATS 2025-10-09 19:17:11 +02:00
bc28807aeb Fixed a typo 2025-10-02 23:36:10 +02:00
1e8e8e9b40 Sleep causes threads to hang (python internal issue) 2025-08-27 19:22:06 +02:00
e7a8dcfcb3 Disambiguate image from video servers 2025-08-27 17:47:42 +02:00
461031aa3a Exit retry loop 2025-08-26 18:19:56 +02:00
dd4447f756 Get response not body 2025-08-26 18:15:03 +02:00
a2bb0e38cf Don't die on missing thumbnails 2025-08-26 18:01:53 +02:00
31b7ce76df Fixed invalid function name 2025-08-15 19:32:27 +02:00
965384c3f2 Fixed invalid function names 2025-08-15 19:31:33 +02:00
6dddf7985c Fixed missing "self" 2025-08-15 19:30:33 +02:00
081efaeb9f Added more http methods to scraper 2025-08-15 19:27:21 +02:00
6fc820b397 Added ListURL 2025-08-09 17:12:56 +02:00
68b6a505c1 Close handle when deleted 2025-08-09 17:00:56 +02:00
462d24ab5e Ignore removed posts 2025-08-09 17:00:38 +02:00
abdcef0a80 Fixed handle leak 2025-08-09 16:13:25 +02:00
a0e38071d8 When bot detection kicks in, timeout and reload CloudScraper 2025-08-09 05:12:15 +02:00
12038f9477 Fixed view identification 2025-08-09 04:31:37 +02:00
dddb0e9583 Fixed handle leak 2025-08-09 04:25:24 +02:00
c9928342c2 Added ViewURL 2025-08-09 04:24:37 +02:00
14ed66aad7 Added empty Post constructor 2025-08-09 04:24:16 +02:00
8f228bde36 Close response handles 2025-08-09 02:27:23 +02:00
7ca4c4bfac Added scraper.reset 2025-08-09 02:25:50 +02:00
8fa6e2cce4 Made urls consistent 2025-08-09 02:06:04 +02:00
e4814f8a37 Added is_view check, fixed exception constructors, added sample image 2025-08-09 02:04:45 +02:00
f879535b25 Samples are always JPG 2025-08-09 01:07:29 +02:00
41ecfaec90 Added SampleURL 2025-08-08 23:40:23 +02:00
435fcd2fc3 Add "is None" checks, instead of infering 2025-08-08 06:01:20 +02:00
3831b95161 Changed to ThreadPoolExecutor 2025-08-06 04:35:18 +02:00
6834a2d056 Retry if received captcha 2025-08-04 14:58:07 +02:00
8dd0b576a2 Removed empty "tags" 2025-08-04 14:40:38 +02:00
d112ea4ce9 Added threadpool 2025-08-04 14:34:04 +02:00
1cc617aeda Check for invalid posts 2025-08-02 23:23:21 +02:00
bebb39e722 Reoredered formats 2025-08-02 23:23:02 +02:00
38e081a741 Move list of known extensions to py34.url 2025-08-02 15:42:08 +02:00
1653e8db7c Allow requesting without downloading 2025-08-02 15:41:50 +02:00
3372af33c4 Modified how post thumbnails are handled 2025-08-02 03:46:33 +02:00
9726a3018e Enforced variable types 2025-08-02 03:14:38 +02:00
7ad8b14fdc Improved URL Handling, Added View to Post convertion 2025-08-01 23:38:20 +02:00
317d81f995 Improved URL handling 2025-08-01 15:12:50 +02:00
56fdad7fd4 Added .editorconfig 2025-08-01 05:16:49 +02:00
9db30c0194 Removed todo.txt 2025-08-01 05:01:15 +02:00
013a3b8e35 Cleaned .gitignore 2025-08-01 04:59:31 +02:00
c64c4225ff Implemented everything, removed scraper 2025-08-01 04:52:27 +02:00
4a632d146a Reorganized the project 2025-07-30 13:07:01 +02:00
42d31a68c4 Fixed imports, tags 2025-07-30 11:02:52 +02:00
46f7d3a27d Initial commit 2025-07-26 22:52:02 +02:00