Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 10ecd41444 feat(StealthyFetcher): Add the redirections history Karim shoair 2025-02-22 18:45:17 +02:00
• 8049ac0f28 feat(PlayWrightFetcher): Add the redirections history Karim shoair 2025-02-22 17:47:27 +02:00
• 3d2418b67a feat(Fetcher): Add the redirections history to Fetcher Karim shoair 2025-02-22 16:58:54 +02:00
• f0db07a31f build: pumping up deps and version to 0.2.94 Karim shoair 2025-02-22 15:25:35 +02:00
• 390bd51cb1 fix(TextHandler): correcting case_sensitive argument logic Karim shoair 2025-02-22 15:20:11 +02:00
• db068f4eaa build: fix classifiers Karim shoair 2025-01-31 03:53:28 +02:00
• e40a1e1f73 Merge pull request #33 from D4Vinci/dev Karim shoair 2025-01-31 03:43:05 +02:00
• 7c35341d85 refactor(parser/get_all_text): Cleaner and a bit faster implementation Karim shoair 2025-01-31 02:47:49 +02:00
• a6fd25f64c fix(parser): fix traverse selectors Karim shoair 2025-01-31 01:57:19 +02:00
• a8d475afb0 feat(parser): Make all returned html as TextHandler Karim shoair 2025-01-31 01:38:48 +02:00
• 3330e9f475 refactor(parser/automatch): Cleaner and faster implementation Karim shoair 2025-01-31 01:34:02 +02:00
• 37a31a120e refactor(parser/find_by_regex): Better implementation for ~60% speed boost Karim shoair 2025-01-31 01:19:11 +02:00
• 2c6142d96d refactor(parser/find_by_text): Better implementation for ~20% speed boost Karim shoair 2025-01-31 01:12:00 +02:00
• 9ea245eab4 doc(README): be more specific about what the regex match Karim shoair 2025-01-31 00:48:59 +02:00
• 3f23f18473 style(TextHandler): fix re overload Karim shoair 2025-01-31 00:48:27 +02:00
• 1962c11f64 fix(parser/find_all): Logic issues made conditions used sometimes in a (and) fashion and other times (OR) Karim shoair 2025-01-31 00:23:54 +02:00
• 57090f90a4 refactor(parser/find_all): about ~95% speed increase Karim shoair 2025-01-30 23:39:46 +02:00
• f37538320f feat(parser): adding below_elements method Karim shoair 2025-01-30 23:05:10 +02:00
• ae60c2c0ad fix(playwright engine): bug in checking nstbrowser_config type Karim shoair 2025-01-30 20:07:19 +02:00
• 148103f3c8 fix(translator): increase CSS to XPath convertor cache limit Karim shoair 2025-01-30 20:01:25 +02:00
• c0d912d16a fix(asyncFetcher): A typo made async version of put do post request instead Karim shoair 2025-01-30 19:53:13 +02:00
• 7882cf2527 style(TextHandler): Setting overload on check_match argument for auto completion Karim shoair 2025-01-30 02:44:57 +02:00
• e507778c48 feat(Parser): Set regex methods new return types as TextHandlers Karim shoair 2025-01-30 02:27:38 +02:00
• 93be416572 feat(TextHandler): Now regex methods return TextHandler/TextHandlers Karim shoair 2025-01-30 02:15:09 +02:00
• 4e2e7a4b22 fix(parser): More on correcting type hints and unifying return type Karim shoair 2025-01-30 02:03:09 +02:00
• 7ee0f6114d fix(parser): Code restructure for speed boost & better type hints Karim shoair 2025-01-30 01:46:33 +02:00
• 1d5fcc060d feat(TextHandler): Make slicing return TextHandlers + autocompletion fixes Karim shoair 2025-01-29 14:22:47 +02:00
• 70ffdd09e2 feat(TextHandler): Make split string method return Texthandlers Karim shoair 2025-01-29 01:22:07 +02:00
• 5047e886a5 style(autocompletion): Improving type hints for custom types Karim shoair 2025-01-29 00:58:14 +02:00
• 85f98708b2 feat(StealthyFetcher): Use memory cache by default for performance boost Karim shoair 2025-01-28 23:55:24 +02:00
• e9e606bca5 feat(StealthyFetcher): Disable Cross-Origin-Opener-Policy by default for async_fetch Karim shoair 2025-01-28 23:53:12 +02:00
• 675c0110e6 feat(StealthyFetcher): Make ads enabled by default for performance boost Karim shoair 2025-01-28 23:51:31 +02:00
• 52b66c98ec feat(StealthyFetcher): Disable Cross-Origin-Opener-Policy by default Karim shoair 2025-01-28 23:47:47 +02:00
• 1332be7e63 fix(autocompletion): Fix the defaults import Karim shoair 2025-01-28 23:44:58 +02:00
• c2447e069e build: Pumping version up Karim shoair 2025-01-28 23:41:48 +02:00
• 99fe842bc9 build: updating dependencies Karim shoair 2025-01-28 23:40:56 +02:00
• 21291958f1 docs(README file): Better more-friendly description Karim shoair 2025-01-28 23:10:56 +02:00
• 198b76f5d5 Test: disable stealth parameter Karim shoair 2025-01-28 13:43:36 +02:00
• 7776e191e8 Update test_playwright.py Karim shoair 2025-01-28 13:42:11 +02:00
• 75a965e802 Update FUNDING.yml Karim shoair 2025-01-27 21:14:50 +02:00
• 0e1dcd4f29 Adding Scrapeless sponsor Karim shoair 2025-01-06 11:59:19 +02:00
• 32d96606ea Merge pull request #27 from D4Vinci/dev Karim shoair 2024-12-26 20:03:24 +02:00
• c5d83a11ad build: Pumping version up Karim shoair 2024-12-26 19:57:25 +02:00
• ef284234e6 docs: update README file to reflect new installation instructions Karim shoair 2024-12-26 19:56:37 +02:00
• 03b52aa74c feat(cli): adding terminal command scrapling install Karim shoair 2024-12-26 19:46:22 +02:00
• 2006be2173 fix(StealthyFetcher): Use more dependable response data Karim shoair 2024-12-26 00:29:42 +02:00
• f9b85cfbac fix(PlaywrightFetcher): Use more dependable response data Karim shoair 2024-12-26 00:27:13 +02:00
• 3cca3fd56b style(parser): more accurate type hints Karim shoair 2024-12-21 16:17:02 +02:00
• ee599141fe Merge pull request #26 from D4Vinci/dev Karim shoair 2024-12-19 13:51:53 +02:00
• bb398693b8 feat(Fetcher): Adding support to proxies using the SOCKS protocol Karim shoair 2024-12-19 13:30:43 +02:00
• f74db648bc build: Pumping up the version to 0.2.91 Karim shoair 2024-12-19 13:29:45 +02:00
• 5be8c2a95e style(Fetchers): Setting correct type hint for wait_selector_state argument Karim shoair 2024-12-19 13:22:12 +02:00
• 94745b1555 fix(StealthyFetcher): Wait for the real response status code Karim shoair 2024-12-19 13:08:41 +02:00
• 844cb0c6a2 fix(PlaywrightFetcher): Wait for the real response status code Karim shoair 2024-12-19 13:00:19 +02:00
• 6652b8ac18 fix: solve the response log issue so now you get log for every response from Fetchers Karim shoair 2024-12-19 12:29:34 +02:00
• 60df72cb23 Merge pull request #25 from D4Vinci/dev Karim shoair 2024-12-16 14:42:13 +02:00
• 838b8b1196 style: fixing a typo in logging Karim shoair 2024-12-16 13:39:30 +02:00
• c282cb3cb7 fix: Stopped the log spamming that happens with multiple instances creation Karim shoair 2024-12-16 13:35:48 +02:00
• ac95600650 docs: add an example that uses page.urljoin Karim shoair 2024-12-16 13:27:14 +02:00
• 20ef45349a test: Rewrite automatch tests to a cleaner version and adding async test Karim shoair 2024-12-16 13:18:19 +02:00
• 69e31612a5 test: Rewrite parser tests to a cleaner version and adding more tests Karim shoair 2024-12-16 13:17:09 +02:00
• 3ff0d55c3e chore: Delete former-sponsor banner Karim shoair 2024-12-16 12:47:43 +02:00
• 43b41b3733 docs: fix TOC header Karim shoair 2024-12-16 12:41:07 +02:00
• 6cf5ce9719 docs: Adding async examples and fixing some typos Karim shoair 2024-12-16 12:39:44 +02:00
• 05c6eeb387 fix: add AsyncFetcher to top-level shortcuts Karim shoair 2024-12-16 12:37:29 +02:00
• d66ebc19a5 fix(Fetchers/disable_resources): Fixing the logic for intercepting resources Karim shoair 2024-12-16 12:35:25 +02:00
• eceef48ef5 fix(Fetchers/page_action): Fixing logic Karim shoair 2024-12-16 12:34:23 +02:00
• 3ecffcb81c style: Rewrite sync Fetchers tests to a cleaner version Karim shoair 2024-12-16 01:27:18 +02:00
• 2606f7a12d test: clearer naming for async tests Karim shoair 2024-12-16 01:01:59 +02:00
• 448587ff41 test: add tests for StealthyFetcher async fetch Karim shoair 2024-12-16 01:00:05 +02:00
• 79a911e24e feat(StealthyFetcher): Add async fetch support Karim shoair 2024-12-16 00:59:19 +02:00
• efb3270c67 style: Rewrite asyncFetcher tests to a cleaner version Karim shoair 2024-12-16 00:47:02 +02:00
• 361ee440aa test: adding pytest-asyncio plugin to tests requirements file Karim shoair 2024-12-16 00:20:26 +02:00
• de015f2b18 chore: Restructuring fetchers into cleaner structure Karim shoair 2024-12-16 00:19:48 +02:00
• aac77e488c test: add test for PlaywrightFetcher Async support Karim shoair 2024-12-16 00:17:13 +02:00
• af4f2c0f74 feat(PlaywrightFetcher): Add async support for PlaywrightFetcher Karim shoair 2024-12-16 00:15:47 +02:00
• 889c111855 refactor(Playwright Engine): Separate what we can for cleaner code and the async function later Karim shoair 2024-12-15 23:25:02 +02:00
• 6c17bd886e style: using better data structures for constants Karim shoair 2024-12-15 23:19:47 +02:00
• a90192df03 build: adding tests for AsyncFetcher class Karim shoair 2024-12-15 16:54:52 +02:00
• b10cfd3643 feat: Adding AsyncFetcher class version of Fetcher Karim shoair 2024-12-15 16:51:58 +02:00
• faf728a794 style: moving repeated arguments from inside the functions to __init__ Karim shoair 2024-12-15 16:49:48 +02:00
• 445af3c702 perf: Give repeated usage of Fetcher a slight performance increase Karim shoair 2024-12-15 16:13:08 +02:00
• 299793af3f feat: adding the retries argument for all methods of Fetcher class Karim shoair 2024-12-15 15:59:15 +02:00
• 838dd62ee4 build: pumping up camoufox Karim shoair 2024-12-13 20:43:53 +02:00
• f9bee4cbbb build: Pumping up camoufox version to solve browserforge issue Karim shoair 2024-12-12 14:37:31 +02:00
• bfe906315e feat: adding geoip parameter to the StealthyFetcher Karim shoair 2024-12-12 12:43:49 +02:00
• 6f87420e35 build: disable the 501 error test for playwright Karim shoair 2024-12-11 21:44:03 +02:00
• e254341974 fix: forgot to stage it with last commit Karim shoair 2024-12-11 21:43:36 +02:00
• 193827e27b refactor(api)!: Unifying log under 1 logger and removing debug parameter Karim shoair 2024-12-11 21:41:37 +02:00
• f30eb6ab6c build: disable the 404 error test for playwright Karim shoair 2024-12-11 20:27:07 +02:00
• dcf51876a5 fix: Adaptor.body returns raw HTML without processing Karim shoair 2024-12-11 20:18:05 +02:00
• 9f0001af26 feat: logging for response status Karim shoair 2024-12-11 20:14:32 +02:00
• e332444411 Update tests.yml Karim shoair 2024-12-10 23:35:21 +02:00
• 70b54241e4 Update tox.ini Karim shoair 2024-12-10 23:32:54 +02:00
• ba11c433ff Preparing to release 0.2.9 soon Karim shoair 2024-12-10 22:56:51 +02:00
• e60a57c63f Python 3.8 is not supported anymore Karim shoair 2024-12-10 22:37:37 +02:00
• 93ed768312 Bumping up the libraries versions for better stealth and speed! Karim shoair 2024-12-10 22:22:34 +02:00
• b4f90615c3 Adding keep_cdata argument for Adaptor and Response classes Karim shoair 2024-12-10 22:06:08 +02:00
• 5f9c3980dc Adding urljoin method to Adaptors and Responses Karim shoair 2024-12-10 22:02:43 +02:00
• d0f18951ac fix: Enable WebGL by default Karim shoair 2024-12-04 23:38:30 +02:00