Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 2b3c9b8ff3 Merge pull request #4 from marksmayo/main Karim shoair 2024-11-13 11:18:53 +02:00
• b2993d2fcf Update and rename py.typeda to py.typed Mark Mayo 2024-11-13 21:56:02 +13:00
• 067809974e Rename py.typed to py.typeda Mark Mayo 2024-11-13 21:55:51 +13:00
• 4b5f9e12a2 Merge pull request #3 from D4Vinci/dev Karim shoair 2024-11-11 19:29:41 +02:00
• 64c9fe905e Corrections and rephrasing Karim shoair 2024-11-11 16:40:54 +02:00
• bd38fdb347 Corrections and rephrasing Karim shoair 2024-11-11 16:40:46 +02:00
• b3418f7f50 Corrections and rephrasing Karim shoair 2024-11-11 16:40:35 +02:00
• d6b454dc43 Corrections and rephrasing Karim shoair 2024-11-11 16:40:30 +02:00
• eb100e45f7 Corrections and rephrasing Karim shoair 2024-11-11 16:40:21 +02:00
• 79bf4060f4 Updating find_all examples Karim shoair 2024-11-11 12:51:40 +02:00
• e8935b1af8 Update README.md Karim shoair 2024-11-10 23:45:48 +02:00
• 3d4b427168 Rework Selectors generation Karim shoair 2024-11-10 18:19:48 +02:00
• de2d65856c Adding playwright/camoufox tests for cookies and improve the timeout test Karim shoair 2024-11-10 16:31:28 +02:00
• 239e2c73bf Correctly get page content after JS Execution Karim shoair 2024-11-10 16:11:46 +02:00
• 43045e3eb2 Get page content after JS Execution Karim shoair 2024-11-10 15:54:44 +02:00
• 7d2f55bd4c First version of the 0.2 README Karim shoair 2024-11-10 00:09:30 +02:00
• 4b2814404a Fixing the functions-based filtering logic Karim shoair 2024-11-09 22:32:05 +02:00
• 6b62579a7e Making find_all/find methods on steroids Karim shoair 2024-11-09 21:25:17 +02:00
• b90c8adb02 Adding the argument automatch_domain to all fetchers Karim shoair 2024-11-09 15:38:27 +02:00
• 03091beb8b Small clarification Karim shoair 2024-11-09 13:40:50 +02:00
• fd7d787ab0 Add extra_headers argument to PW and isolate google referer feature from stealth mode as google_search Karim shoair 2024-11-09 00:54:11 +02:00
• ee8f78feb1 Update camo.py Karim shoair 2024-11-09 00:48:11 +02:00
• fd34cd9afa Adding arguments google_search and extra_headers to StealthyFetcher Karim shoair 2024-11-09 00:43:24 +02:00
• 530b54d964 Clearer doc-string Karim shoair 2024-11-09 00:17:41 +02:00
• 1b015bbd07 Type correction Karim shoair 2024-11-08 23:59:12 +02:00
• b919536527 Updating the keywords whitelisting logic in find/find_all functions Karim shoair 2024-11-07 12:56:32 +02:00
• 51ce40a561 Update ROADMAP.md Karim shoair 2024-11-07 00:44:23 +02:00
• 91f6b46e6d Adding new filter and search functions to parser Karim shoair 2024-11-07 00:31:14 +02:00
• 846a185b49 Updating parser tests to use find and css_first functions Karim shoair 2024-11-07 00:02:36 +02:00
• b25d2ee79b Adding new find_all and find functions to parser Karim shoair 2024-11-07 00:01:14 +02:00
• 6b40af426f Better logic for css_first and xpath_first Karim shoair 2024-11-06 22:14:33 +02:00
• 5e848ef046 Adding new class type TextHandlers Karim shoair 2024-11-06 21:03:19 +02:00
• 7a84511b7a Making Adaptor and Adaptor re/re_first arguments consistent with the TextHandler ones Karim shoair 2024-11-06 20:47:21 +02:00
• 7af75f78a5 Better logic for Adaptors re_first method Karim shoair 2024-11-06 20:24:30 +02:00
• a1fd5ddc7e Correcting headless argument type Karim shoair 2024-11-06 20:18:44 +02:00
• a0a3e62075 Adding addons and humanize arguments to StealthyFetcher Karim shoair 2024-11-06 20:14:42 +02:00
• 5ad2126030 Small speed boost for fetching by some caching Karim shoair 2024-11-06 19:56:39 +02:00
• a1513ba769 Update tests.yml Karim shoair 2024-11-06 12:54:52 +02:00
• b542b5cc39 Recaching TOX environments Karim shoair 2024-11-06 12:50:14 +02:00
• c30853ee2c Update tox.ini Karim shoair 2024-11-06 12:39:38 +02:00
• fc30cfed4c Update tests.yml Karim shoair 2024-11-06 12:36:46 +02:00
• cd1ff846a7 Update ROADMAP.md Karim shoair 2024-11-06 12:31:57 +02:00
• d632bb14af Moving parser tests to a better structure Karim shoair 2024-11-06 12:30:41 +02:00
• 5548941cf1 Correcting return type for css_first and xpath_first Karim shoair 2024-11-06 12:28:43 +02:00
• e4eb442709 Adding tests for PlayWrightFetcher class Karim shoair 2024-11-06 12:21:55 +02:00
• 4222626ec1 Adding tests for Fetcher class Karim shoair 2024-11-06 12:21:18 +02:00
• 4400363146 Renaming fetchers tests folder for readability Karim shoair 2024-11-06 12:21:06 +02:00
• 9a7f489eb7 make tests verbose for easier debugging later Karim shoair 2024-11-06 12:20:05 +02:00
• 10bcdfb596 Moving bypasses folder deeper Karim shoair 2024-11-06 12:19:26 +02:00
• 6cf506cb22 PlaywrightEngine - Validate CDP URLs in all cases Karim shoair 2024-11-06 11:24:56 +02:00
• 6497b1b559 Type correction Karim shoair 2024-11-06 02:20:33 +02:00
• 24806aecdc Update .gitignore Karim shoair 2024-11-05 23:41:57 +02:00
• 3622040440 Adding css_first and xpath_first for easier usage Karim shoair 2024-11-05 23:41:51 +02:00
• 009c2914aa Fixing re_first logic in Adaptors type Karim shoair 2024-11-05 22:59:47 +02:00
• d50497dff3 Update .gitignore Karim shoair 2024-11-05 22:56:57 +02:00
• ca4b5f205c Since tests can finally now run in Github actions without issues Karim shoair 2024-11-05 13:10:51 +02:00
• 2a275c436c Update tests.yml Karim shoair 2024-11-05 13:02:11 +02:00
• 69cfbe45be Update tests.yml Karim shoair 2024-11-05 12:59:39 +02:00
• 6f91d06b46 Update tests.yml Karim shoair 2024-11-05 12:57:57 +02:00
• 2020214784 please work Karim shoair 2024-11-05 11:45:59 +02:00
• 92d002032d Update tests.yml Karim shoair 2024-11-05 11:44:10 +02:00
• 1bbb5dd75a Update tests.yml Karim shoair 2024-11-05 11:41:58 +02:00
• d4358d32a8 Update tests.yml Karim shoair 2024-11-05 11:38:38 +02:00
• a60662af4a Update camo.py Karim shoair 2024-11-05 11:38:35 +02:00
• 8933a99a6e Update tests.yml Karim shoair 2024-11-05 11:29:28 +02:00
• f200e9b290 looks like playwright need to run as normal user Karim shoair 2024-11-05 11:28:12 +02:00
• 1dd04f8250 Update tests.yml Karim shoair 2024-11-05 02:39:15 +02:00
• 6f7d925a2a Revert "Update tests.yml" Karim shoair 2024-11-05 02:34:43 +02:00
• 33f44587e6 Update tests.yml Karim shoair 2024-11-05 02:33:21 +02:00
• 80cc0b77f3 Update tests.yml Karim shoair 2024-11-05 02:31:34 +02:00
• 4121fe73c9 Update tests.yml Karim shoair 2024-11-05 02:27:30 +02:00
• 72b36d6a26 Fix werkzeug issue and try caching Karim shoair 2024-11-05 02:22:21 +02:00
• a5ffc0be5d Update tests.yml Karim shoair 2024-11-05 02:09:32 +02:00
• 7fd50a4b94 Update tests.yml Karim shoair 2024-11-05 02:06:45 +02:00
• 3b25a248fc Fixing tests action Karim shoair 2024-11-05 02:04:49 +02:00
• e594bba0c4 Testing some of the new tests on Github action Karim shoair 2024-11-05 01:19:50 +02:00
• bd612bb0e2 Updating the disable_resources doc-string Karim shoair 2024-11-04 20:16:04 +02:00
• 544d23b696 Toolbelt fingerprint functions - Doc strings and type annotations stuff Karim shoair 2024-11-03 23:31:09 +02:00
• e270b00811 Toolbelt subpackage custom functions general adjustments Karim shoair 2024-11-03 23:17:20 +02:00
• 2ff0fbb0e5 Engines utils - Navigation functions Karim shoair 2024-11-03 22:46:40 +02:00
• b8afb390ae Renaming fetcher file to fetchers for clarity Karim shoair 2024-11-03 22:43:16 +02:00
• 282b130864 Static Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:25:34 +02:00
• 3af174526f PlayWright Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:24:44 +02:00
• 54cacb8a4e Camoufox Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:20:29 +02:00
• 61fd592a6a Adding documentation to PlaywrightFetcher class Karim shoair 2024-11-03 21:04:11 +02:00
• c1575b8e2e Updating doc-strings for more clarity Karim shoair 2024-11-03 16:49:33 +02:00
• 1d2c68125a Update fetcher.py Karim shoair 2024-11-03 16:40:42 +02:00
• 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation Karim shoair 2024-11-03 16:33:08 +02:00
• 711de81106 PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost Karim shoair 2024-11-03 16:27:55 +02:00
• b32e1203f2 StealthyFetcher - The option to drop unnecessary resources requests for speed boost Karim shoair 2024-11-03 16:27:32 +02:00
• c8c494e73f Adding a function to intercept and drop unwanted requests Karim shoair 2024-11-03 16:25:55 +02:00
• 0867d9e78a Update README.md Karim shoair 2024-11-03 14:48:33 +02:00
• e7e499d64b Add documentation for StealthyFetcher class + add webgl option Karim shoair 2024-11-03 14:45:20 +02:00
• e7300ecba0 StealthFetcher - Add the option to allow webgl in the browser Karim shoair 2024-11-03 14:40:19 +02:00
• 2528d4e023 Add documentation for the Fetcher class Karim shoair 2024-11-03 14:39:24 +02:00
• be350f21dd Adding documentation to the base fetcher... Karim shoair 2024-11-03 13:45:13 +02:00
• 55ab1d63b7 Turn auto_match off when not needed in testing Karim shoair 2024-11-03 13:37:27 +02:00
• eaae5908c9 Make auto_match enabled by default Karim shoair 2024-11-03 13:33:24 +02:00
• a0022f7322 Pumping up camoufox version Karim shoair 2024-11-03 13:20:00 +02:00
• 1ff1c93bcf Give response's body bytes priority over response's text Karim shoair 2024-11-03 13:04:02 +02:00