Driverless (Non-commercial use only!)

Note: This project is moving away from the selenium syntax

Documentation

• Use Selenium without chromedriver
• Currently passes Cloudflare, Bet365, Turnstile, and others
• Multiple tabs simultaneously
• Multiple Incognito-contexts with isolated cookies & local storage
• Proxy-auth support (example code)
• Network-interception (documentation)
• Single requests (documentation)

Getting detected with interactions?

CDP-Patches (headfull only) should fix this \ (will integrate it at some time)

Questions?

Feel free to join the Driverless-Community on Discord:)

Also, see dev-branch for the latest implementations.

Also, feel free to

Sponsors

Capsolver

An AI-powered captcha-solver service.

Dependencies

• Python >= 3.7
• Google-Chrome installed (Chromium not tested)

Installing

• Install Google-Chrome
• pip install selenium-driverless

Usage

with asyncio

from selenium_driverless import webdriver
from selenium_driverless.types.by import By
import asyncio

async def main():
    options = webdriver.ChromeOptions()
    async with webdriver.Chrome(options=options) as driver:
        await driver.get('http://nowsecure.nl#relax', wait_load=True)
        await driver.sleep(0.5)
        await driver.wait_for_cdp("Page.domContentEventFired", timeout=15)

        # wait 10s for elem to exist
        elem = await driver.find_element(By.XPATH, '/html/body/div[2]/div/main/p[2]/a', timeout=10)
        await elem.click(move_to=True)

        alert = await driver.switch_to.alert
        print(alert.text)
        await alert.accept()

        print(await driver.title)

asyncio.run(main())

synchronous

asyncified, might be buggy

custom debugger address

from selenium_driverless import webdriver

options = webdriver.ChromeOptions()
options.debugger_address = "127.0.0.1:2005"

# specify if you don't want to run remote
# options.add_argument("--remote-debugging-port=2005")

async with webdriver.Chrome(options=options) as driver:
  await driver.get('http://nowsecure.nl#relax', wait_load=True)

Multiple tabs simultaneously

Note: asyncio is recommended, threading only works on independent webdriver.Chrome instances.

Isolated execution contexts

• execute javascript without getting detected ( in a isolated world)
  Example Code (Click to expand)

from selenium_driverless.sync import webdriver
from selenium_driverless import webdriver
import asyncio

async def main():
    options = webdriver.ChromeOptions()
    async with webdriver.Chrome(options=options) as driver:
        await driver.get('chrome://version')
        script = """
        const proxy = new Proxy(document.documentElement, {
          get(target, prop, receiver) {
            if(prop === "outerHTML"){
                console.log('detected access on "'+prop+'"', receiver)
                return "mocked value:)"
            }
            else{return Reflect.get(...arguments)}
          },
        });
        Object.defineProperty(document, "documentElement", {
          value: proxy
        })
        """
        await driver.execute_script(script)
        src = await driver.execute_script("return document.documentElement.outerHTML", unique_context=True)
        mocked = await driver.execute_script("return document.documentElement.outerHTML", unique_context=False)
        print(src, mocked)

asyncio.run(main())

Pointer Interaction

see @master/tests/show_mousemove.py for visualization

pointer = driver.current_pointer
move_kwargs = {"total_time": 0.7, "accel": 2, "smooth_soft": 20}

await pointer.move_to(100, 500)
await pointer.click(500, 50, move_kwargs=move_kwargs, move_to=True)

Iframes

iframes = await driver.find_elements(By.TAG_NAME, "iframe")
await asyncio.sleep(0.5)
iframe_document = await iframes[0].content_document
# iframe_document.find_elements(...)

use preferences

from selenium_driverless import webdriver
options = webdriver.ChromeOptions()

 # recommended usage
options.update_pref("download.prompt_for_download", False)
# or
options.prefs.update({"download": {"prompt_for_download": False}})

# supported
options.add_experimental_option("prefs", {"download.prompt_for_download": False})

Multiple Contexts

• different cookies for each context
• A context can have multiple windows and tabs within
• different proxy for each context
• opens as a window as incognito
  Example Code (Click to expand)

from selenium_driverless import webdriver
import asyncio

async def main():
    options = webdriver.ChromeOptions()
    async with webdriver.Chrome(options=options) as driver:
        context_1 = driver.current_context

        await driver.set_auth("username", "password", "localhost:5000")
        # proxy not supported on windows due to https://bugs.chromium.org/p/chromium/issues/detail?id=1310057
        context_2 = await driver.new_context(proxy_bypass_list=["localhost"], proxy_server="http://localhost:5000")

        await context_1.current_target.get("https://examle.com")
        await context_2.get("https://examle.com")
        input("press ENTER to exit:)")

asyncio.run(main())

Custom exception handling

You can implement custom exception handling as following

import selenium_driverless
import sys
handler = (lambda e: print(f'Exception in event-handler:\n{e.__class__.__module__}.{e.__class__.__name__}: {e}',
                           file=sys.stderr))
sys.modules["selenium_driverless"].EXC_HANDLER = handler
sys.modules["cdp_socket"].EXC_HANDLER = handler

Help

You found a bug? Feel free to open an issue:) You've got other questions or proposials? feel free to join the Driverless-Community on Discord or open a discusion\

Copyright and Author

Aurin Aegerter (aka Steve)

License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License with an addition for Section 1(k) in the LEGAL CODE:

Commercial means primarily intended for or directed towards commercial advantage or monetary compensation. \ A business, project or public agreement with a commercial intent of any kind which profits more than, or equal to 7'000 US-Dollar per month, or any monetary equivalent to that, is not subject to this definition of NonCommercial.

If you wish to use this project commercially, you can contact the author for a custom License. This usually includes a fee of around 5-6% based on your current profit.

Disclaimer

This project is meant for educational purposes only. Use it responsibly. \ The Author does not provide any warranty and is not liable in any way for what or how it gets used.

Acknowledgments

Inspiration, code snippets, etc.

• selenium_driverless/utils/find_chrome_executable
• cdp-socket
• jsobject
• pycdp/browser.py