"Dockerfile" file content:

FROM python:3.10-alpine


EXPOSE 5900


COPY ./requirements.txt /tmp/requirements.txt
COPY ./app /app
COPY ./scripts /scripts


# Install temporary dependencies
RUN apk update && apk upgrade && \
    apk add --no-cache --virtual .build-deps \
    alpine-sdk \
    curl \
    python3 \
    wget \
    unzip \
    gnupg 


# Install dependencies
RUN apk add --no-cache \
    xvfb \
    x11vnc \
    fluxbox \
    xterm \
    libffi-dev \
    openssl-dev \
    zlib-dev \
    bzip2-dev \
    readline-dev \
    git \
    nss \
    freetype \
    freetype-dev \
    harfbuzz \
    ca-certificates \
    ttf-freefont \
    chromium \
    chromium-chromedriver



# Install Python dependencies
RUN pip install --no-cache-dir -r /tmp/requirements.txt && \
    rm /tmp/requirements.txt


WORKDIR /app


# RUN chmod -R +x /scripts


# ENV PATH="/scripts:$PATH"
# ENV DISPLAY=:0
ENV PYTHONUNBUFFERED=1 \
    PYTHONHASHSEED=random \
    MEMORY_LIMIT="512M"


# Delete temporary dependencies
RUN apk del .build-deps


CMD ["python3", "main.py"]

"docker-compose.yml" file:

version: '3.1'
services:
  chrome:
    build:
      context: .
      dockerfile: Dockerfile
    ports:
      - 5900:5900
    volumes:
      - ./app:/app
    shm_size: '2g'

Hola quería preguntarles PQ mi código no reconoce el Select, ya use el ID, lo busque por el value, y por xpath pero no me reconoce el código.. únicamente necesito que el Select me seleccione el value 1 (siempre será ese valor) alguien me puede ayudar? O si saben dónde puedo ver tutoriales de esto

If you are intersted improve the optimization and faster load in head mode it would be good put an android user agent. Why? Mainly for the image size wich are smaller and other stuffs

The user-agent i use:

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, como Gecko) Chrome/135.0.0.0 Safari/537.36

I have been work on code to scrape insta post comments and like data's But i have this probelm with the comment It dont collect all the comment it skip the comments that have multi mention like (@anas @mack )and if there text at the end too can any one help me with the right xpath To make it collect all the deferent comments

Ever wondered about the mystery of how some websites hide their content behind scripts, JSON, or paywalls?

This is one of my Own Experience
I've noticed that some sites don’t render the full article directly in the DOM. Often, the content is embedded in JSON inside <script> tags — meant for search engines or social

Here’s a small demo using Python Selenium that extracts article content from structured data:
What’s happening here:

1.We check if a paywall element exists.

2.Then we grab the JSON that contains the full article content.

3.Finally, we render it nicely in the browser console or page.

Sometimes the full article is sitting right there, quietly waiting to be discovered … if you know where to look .

I can't get to match the versions of chromedriver and chrome browser

last version of chromedriver is .88

last version of google chrome is .89 ( it updated automatically so it broke my script)

yes, google provide older versions of chrome, but doesnt give me an install file, it gives me a zip with several files ( as if it were installed, sort of- sorry, im newbie) , and I dont know what to do with that

could someone help ? thanks!

edit: IDK what I did, it just started working. After that, it broke again and mismatched the versions.

then, deleting C:\Users\MyUser\.wdm FIXED IT

I'm currently working on a project that requires automating the solving of reCAPTCHA dialogs. I need to solve a large number of them quickly and concurrently.

Initially, I used a script that converted the audio CAPTCHA into text, but it had several drawbacks: it was slow and could only handle one CAPTCHA at a time. Since my project requires concurrency, this approach was inadequate.

I later switched to using a browser extension called NopeCHA, which resolved the concurrency issue. However, it introduces a new problem—the extension needs to be pre-configured, which is cumbersome and not scalable.

I'm now looking for a more efficient solution—one that can solve reCAPTCHA dialogs rapidly and concurrently, without requiring manual setup or browser-based extensions.

Has anyone developed a method or tool that addresses this?

Hello everyone, I need some help because I'm trying to run selenium in headless mode on my proxmox server but it's not working. Here are the specifics:

- i set up a proxmox container with ubuntu-24.10-standard_24.10-1_amd64.tar.zst

- i created inside a venv for python, installed selenium and the necessary packages and chrome.

- I created a test_selenium.py script like this:

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.chrome.service import Service
from webdriver_manager.chrome import ChromeDriverManager

# Set up Chrome options
chrome_options = Options()
chrome_options.add_argument("--headless=new")  # use new headless mode if available
chrome_options.add_argument("--disable-gpu")
chrome_options.add_argument("--no-sandbox")
chrome_options.add_argument("--disable-dev-shm-usage")
chrome_options.add_argument("window-size=1920x1080")

# Install Chromedriver and initialize the service
driver_path = ChromeDriverManager().install()
print(f"Chromedriver path: {driver_path}")
service = Service(driver_path)

# Create the webdriver instance
driver = webdriver.Chrome(service=service, options=chrome_options)

# Navigate to a webpage
driver.get("https://www.example.com")
print("Page Title:", driver.title)

# Close the browser
driver.quit()

Now when I run the script I obtain:

selenium.common.exceptions.SessionNotCreatedException: Message: session not created: DevToolsActivePort file doesn't exist
Stacktrace:
#0 0x6395a5333ffa <unknown>
#1 0x6395a4df2970 <unknown>
#2 0x6395a4e318e8 <unknown>
#3 0x6395a4e2cdca <unknown>
#4 0x6395a4e2818f <unknown>
#5 0x6395a4e78bd9 <unknown>
#6 0x6395a4e78106 <unknown>
#7 0x6395a4e6a063 <unknown>
...#19 0x7565c6b33a4c <unknown>

Then I added to the code:

chrome_options.add_argument("--remote-debugging-port=9222")

And I obtain the error:

selenium.common.exceptions.SessionNotCreatedException: Message: session not created from chrome not reachable

What am I doing wrong? can someone help me?

It doesn't let me proceed or click any other button without manually closing the popup which I cannot do when I run the script with the headless argument. Any help would be much appreciated!

Hi there,

I'm a newbie so please bear with me. I've setup a container on Proxmox and have installed docker and Selenium Standalone Chrome (in the console it's coming back as having installed the repository for this).

I can access the Selenium Grid (at http://192.168.1.126:4444/ rather than localhost) and I can see it on the grid.

However, I can't access http://192.168.1.126:4444/wd/hub from a browser (says it can't find the handler) and when I try the following command it says 'too many arguments.

from selenium import webdriver

Any idea where to go next?

What I'm trying to do is to use Home Assistant (running on a separate VM in Proxmox) to pull the data from the following Python Script using the UKBinCollection integration found here (https://github.com/robbrad/UKBinCollectionData)

python collect_data.py ForestOfDeanDistrictCouncil https://community.fdean.gov.uk/s/waste-collection-enquiry -s -p "XXXX XXX" -n XX -w http://192.168.1.126:444/

Where I would enter the information at p as my postcode; n being the house number and w being the remote selenium URL.

I’m trying to run the “chromedriver” command on python (selenium). I have the chrome.exe in a folder that I can successfully path on Python, but I can’t fire the “chromedriver” command. I have it blocked as it gets considered suspicious/malware and can’t find a way to disable the block on it. Hopefully someone can help me ✌🏼

Hello everyone, I am unable to install selenium in colab. I followed step by step procedures given on YouTube video as well used chatgpt & colab assistant. But I couldn't install it successfully. Is some directory changed in source code or what's the issue? Can you please help me?

I have a website from which I want to take some data. There is a table that lists the first 50 rows (scrollbar represents the totality of rows), and as you scroll down it loads the rows in batches of 50 rows and unloads the previous 50 (confirmed by watching the HTML, which always has only 50 ‘tr’ elements).

I have tried sending keys but does not work as once the focused line reaches the 50th, this returns to the beginning of the current “batch”.

Any ideas on how to do it? By now I am stopping after every batch, scroll manually to next batch (easy to miss batches) and continue, but I have pages of more than 20 batches.

Hello,

I'm using Selenium to extract data from interactions on a static web page. The page itself relies on JavaScript to call several APIs. I use Selenium to automate interactions and test the "system", but I also need to allow the automated interactions via a public API.

Currently, I have an API (using lambda functions) that triggers Selenium with custom interactions. However, this setup feels a bit heavy. I managed to put everything into a FastAPI server, but I’m wondering if there’s a more efficient or lightweight alternative than combining Selenium and FastAPI.

Is there an existing tool better suited for this use case? Or any better way to use these tools and that you would be aware of?

Any insights would be greatly appreciated. Thanks!

Hello, I'm new to web scraping and selenium and wanted to web scrape this website:
https://rarediseases.info.nih.gov/diseases/21052/10q223q233-microduplication-syndrome

one of the texts I want to grab is the disease summary, which seems to be the child of the element denoted by this XPATH: "/html/body/app-root/app-disease-about/disease-at-a-glance/div/div/div[2]/div[1]/app-disease-at-a-glance-summary/div/div[1]/div/div"

the line of code I'm trying to run to grab it is:

driver.find_element(By.XPATH, "/html/body/app-root/app-disease-about/disease-at-a-glance/div/div/div[2]/div[1]/app-disease-at-a-glance-summary/div/div[1]/div/div").text

However, whenever my code runs, it returns an empty ' ' string
I've tried adding "//*" at the end of the XPATH as it seems like the text is actually stored as a child element, but I get a "no such element" exception. I've looked into CSS selectors but seem to run into the same issues. I've looked everywhere and couldn't find a solution or explanation, but I also recognize my experience with HTML and web scraping is limited. Any suggestions and help are greatly appreciated!

Hey all - I'm going a bit crazy here and not sure why this is suddenly happening.

Background: I have a number of Python (3.12) programs which use Selenium (4.19) to perform business process tasks on external websites for which there are no APIs that I can interact with directly. Essentially, these 'bots' perform a huge amount of repetitive/data entry work which would otherwise require a LOT of human labor.

These programs have been running without issue for months. Nothing has changed in regards to the Python environment. The code specified chrome version 121, and selenium manager makes sure the proper versions of Chrome and ChromeDriver are used. All of a sudden, this past Friday evening (Oct 25, approx 6PM EDT), I started seeing every program throw an exception ("selenium.common.exceptions.WebDriverException: Message: disconnected: not connected to DevTools") within a few moments of execution:

Traceback (most recent call last):
  File "C:\Users\automatedproc\Desktop\Compiled Bots\python\loop_so_entry\loop_status_check.py", line 134, in <module>    browser.find_element(By.CSS_SELECTOR,("input[aria-label='Filter LID']")).send_keys(str(wt["lid"][i]))
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\webdriver.py", line 741, in find_element return self.execute(Command.FIND_ELEMENT, {"using": by, "value": value})["value"]
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\webdriver.py", line 347, in execute self.error_handler.check_response(response)
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\errorhandler.py", line 229, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: disconnected: not connected to DevTools
  (failed to check if window was closed: disconnected: not connected to DevTools)
  (Session info: chrome=121.0.6167.184)

The exception is thrown at different points from different individual programs, but it's always within a few moments (30-60 seconds) after the browser launches and automated control of the browser begins.

It APPEARS as if the browser is crashing, leaving no browser for the WebDriver to control. Again, this started happening suddenly this past Friday evening, with zero changes of any kind to anything on the machine this runs on.

Since then, I updated to the current version of Selenium (4.25) and have been able to get things working again, but ONLY when Selenium is controlling the installed Chrome browser (currently 130). If any version OTHER than the installed Chrome version is specified - for example 128 or 129 - then the browser crashes shortly after launch. When I specify the same version as the installed version of Chrome, then everything works without issue, as it always had.

This is fine for now, since the current version of selenium/selenium manager support Chrome 130 (the current stable release) but I'm concerned about what will happen when the browser updates itself, which is why I have always specified a specific Chrome version and had selenium manager deal with the chromedriver and chrome versions so they match.

I am NOT a developer - I'm very much an IT generalist - so perhaps this is just completely over my head and there's something simple I'm not understanding? But this behavior is happening on multiple machines (all with Python 3.12 and Selenium 4.25), one of which I just set up with a fresh install of Windows 11 earlier today.

Out of desperation, I wrote some quick minimal code to test behavior:

from selenium import webdriver
import time
import os
from datetime import datetime
import logging

baseFilePath = "C:/users/username/desktop/"
botName = "testing"
computerName = os.environ.get("COMPUTERNAME")
logFilePathAndName =  baseFilePath + datetime.now().strftime("%Y%m%d") + "-" + botName + "-" + computerName + ".txt"
logging.basicConfig(filename=logFilePathAndName,level=logging.DEBUG, format='%(asctime)s - %(levelname)s - %(message)s', datefmt='%d-%b-%y %H:%M:%S')
logging.info("Started execution")

def initWebdriver(dlPath:str= None, chromeVer:str="129"):
    browserOpts = webdriver.ChromeOptions()
    browserOpts.browser_version = chromeVer
    browserPrefs = {"credentials_enable_service":False,"profile.password_manager_enabled": False}
    if dlPath:
        browserPrefs["download.default_directory"]= dlPath.replace("/","\\")
        browserPrefs["download.prompt_for_download"]= False
        logging.info("Setting chrome download path to: %s",dlPath.replace("/","\\"))
    browserOpts.add_experimental_option("excludeSwitches", ["enable-automation","enable-logging"])
    browserOpts.add_experimental_option("prefs", browserPrefs)
    browserOpts.add_argument("--disable-single-click-autofill")
    browserOpts.add_argument("--window-size=1300,1000")
    #browserOpts.add_argument("--disable-search-engine-choice-screen")
    #browserOpts.add_argument("--disable-gpu")
    #browserOpts.add_argument("--enable-logging")
    #browserOpts.add_argument("--v=1")
    #browserOpts.add_argument("--no-sandbox")
    browserOpts.set_capability("goog:loggingPrefs", {"performance": "ALL"})
    browser = webdriver.Chrome(options=browserOpts)
    try:
        logging.info("Chrome broswer version: %s", browser.capabilities["browserVersion"])
    except:
        pass
    return browser

try:
    browser = initWebdriver(chromeVer="129")
    while True:
        browser.get("http://apple.com")
        time.sleep(2)
        browser.get("http://google.com")
        time.sleep(2)
        browser.get("http://microsoft.com")
        time.sleep(2)
except Exception as e:
    logging.error("UNHANDLED MAIN ROUTINE occurred", exc_info=True)

Below is the entries to the logfile produced by the code above. You can see that despite this code containing just some simple "get" commands, the exception is thrown shortly after Chrome is launched. This can be reproduces on my personal machine (W11P), a W10P VM which JUST runs various 'bots', and a W11P machine I just set up with a fresh install of Win 11 earlier today - same results.

28-Oct-24 17:04:01 - INFO - Started execution
28-Oct-24 17:04:01 - DEBUG - Selenium Manager binary found at: C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\common\windows\selenium-manager.exe
28-Oct-24 17:04:01 - DEBUG - Executing process: C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\common\windows\selenium-manager.exe --browser chrome --browser-version 129 --debug --language-binding python --output json
28-Oct-24 17:04:03 - DEBUG - Sending stats to Plausible: Props { browser: "chrome", browser_version: "129", os: "windows", arch: "amd64", lang: "python", selenium_version: "4.25" }
28-Oct-24 17:04:03 - DEBUG - chromedriver not found in PATH
28-Oct-24 17:04:03 - DEBUG - chrome detected at C:\Program Files\Google\Chrome\Application\chrome.exe
28-Oct-24 17:04:03 - DEBUG - Running command: wmic datafile where name='C:\\Program Files\\Google\\Chrome\\Application\\chrome.exe' get Version /value
28-Oct-24 17:04:03 - DEBUG - Output: "\r\r\n\r\r\nVersion=130.0.6723.70\r\r\n\r\r\n\r\r\n\r"
28-Oct-24 17:04:03 - DEBUG - Detected browser: chrome 130.0.6723.70
28-Oct-24 17:04:03 - DEBUG - Discovered chrome version (130) different to specified browser version (129)
28-Oct-24 17:04:03 - DEBUG - Discovering versions from https://googlechromelabs.github.io/chrome-for-testing/known-good-versions-with-downloads.json
28-Oct-24 17:04:03 - DEBUG - Required browser: chrome 129.0.6668.100
28-Oct-24 17:04:03 - DEBUG - chrome 129.0.6668.100 already exists
28-Oct-24 17:04:03 - DEBUG - chrome 129.0.6668.100 is available at C:\Users\username\.cache\selenium\chrome\win64\129.0.6668.100\chrome.exe
28-Oct-24 17:04:03 - DEBUG - Discovering versions from https://googlechromelabs.github.io/chrome-for-testing/known-good-versions-with-downloads.json
28-Oct-24 17:04:03 - DEBUG - Required driver: chromedriver 129.0.6668.100
28-Oct-24 17:04:03 - DEBUG - chromedriver 129.0.6668.100 already in the cache
28-Oct-24 17:04:03 - DEBUG - Driver path: C:\Users\username\.cache\selenium\chromedriver\win64\129.0.6668.100\chromedriver.exe
28-Oct-24 17:04:03 - DEBUG - Browser path: C:\Users\username\.cache\selenium\chrome\win64\129.0.6668.100\chrome.exe
28-Oct-24 17:04:03 - DEBUG - Started executable: `C:\Users\username\.cache\selenium\chromedriver\win64\129.0.6668.100\chromedriver.exe` in a child process with pid: 1980 using 0 to output -3
28-Oct-24 17:04:03 - DEBUG - POST http://localhost:57572/session {'capabilities': {'firstMatch': [{}], 'alwaysMatch': {'browserName': 'chrome', 'pageLoadStrategy': <PageLoadStrategy.normal: 'normal'>, 'browserVersion': None, 'goog:loggingPrefs': {'performance': 'ALL'}, 'goog:chromeOptions': {'excludeSwitches': ['enable-automation', 'enable-logging'], 'prefs': {'credentials_enable_service': False, 'profile.password_manager_enabled': False}, 'extensions': [], 'binary': 'C:\\Users\\username\\.cache\\selenium\\chrome\\win64\\129.0.6668.100\\chrome.exe', 'args': ['--disable-single-click-autofill', '--window-size=1300,1000']}}}}
28-Oct-24 17:04:03 - DEBUG - Starting new HTTP connection (1): localhost:57572
28-Oct-24 17:04:04 - DEBUG - http://localhost:57572 "POST /session HTTP/1.1" 200 0
28-Oct-24 17:04:04 - DEBUG - Remote response: status=200 | data={"value":{"capabilities":{"acceptInsecureCerts":false,"browserName":"chrome","browserVersion":"129.0.6668.100","chrome":{"chromedriverVersion":"129.0.6668.100 (cf58cba358d31ce285c1970a79a9411d0fb381a5-refs/branch-heads/6668@{#1704})","userDataDir":"C:\\Users\\username\\AppData\\Local\\Temp\\scoped_dir1980_1934999438"},"fedcm:accounts":true,"goog:chromeOptions":{"debuggerAddress":"localhost:57600"},"networkConnectionEnabled":false,"pageLoadStrategy":"normal","platformName":"windows","proxy":{},"setWindowRect":true,"strictFileInteractability":false,"timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"unhandledPromptBehavior":"dismiss and notify","webauthn:extension:credBlob":true,"webauthn:extension:largeBlob":true,"webauthn:extension:minPinLength":true,"webauthn:extension:prf":true,"webauthn:virtualAuthenticators":true},"sessionId":"ab1a8c304a979d2230b97c4a5621db00"}} | headers=HTTPHeaderDict({'Content-Length': '885', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:04 - DEBUG - Finished Request
28-Oct-24 17:04:04 - INFO - Chrome broswer version: 129.0.6668.100
28-Oct-24 17:04:04 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://apple.com'}
28-Oct-24 17:04:05 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:05 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:05 - DEBUG - Finished Request
28-Oct-24 17:04:07 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://google.com'}
28-Oct-24 17:04:08 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:08 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:08 - DEBUG - Finished Request
28-Oct-24 17:04:10 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://microsoft.com'}
28-Oct-24 17:04:13 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:13 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:13 - DEBUG - Finished Request
28-Oct-24 17:04:15 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://apple.com'}
28-Oct-24 17:04:16 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:16 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:16 - DEBUG - Finished Request
28-Oct-24 17:04:18 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://google.com'}
28-Oct-24 17:04:19 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:19 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:19 - DEBUG - Finished Request
28-Oct-24 17:04:21 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://microsoft.com'}
28-Oct-24 17:04:22 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:22 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:22 - DEBUG - Finished Request
28-Oct-24 17:04:24 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://apple.com'}
28-Oct-24 17:04:25 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:25 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:25 - DEBUG - Finished Request
28-Oct-24 17:04:27 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://google.com'}
28-Oct-24 17:04:27 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:27 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:27 - DEBUG - Finished Request
28-Oct-24 17:04:29 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://microsoft.com'}
28-Oct-24 17:04:31 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:31 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:31 - DEBUG - Finished Request
28-Oct-24 17:04:33 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://apple.com'}
28-Oct-24 17:04:34 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:34 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:34 - DEBUG - Finished Request
28-Oct-24 17:04:36 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://google.com'}
28-Oct-24 17:04:36 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:36 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:36 - DEBUG - Finished Request
28-Oct-24 17:04:38 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://microsoft.com'}
28-Oct-24 17:04:40 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:40 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:40 - DEBUG - Finished Request
28-Oct-24 17:04:42 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://apple.com'}
28-Oct-24 17:04:43 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:43 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:43 - DEBUG - Finished Request
28-Oct-24 17:04:45 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://google.com'}
28-Oct-24 17:04:46 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 200 0
28-Oct-24 17:04:46 - DEBUG - Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'Content-Length': '14', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:46 - DEBUG - Finished Request
28-Oct-24 17:04:48 - DEBUG - POST http://localhost:57572/session/ab1a8c304a979d2230b97c4a5621db00/url {'url': 'http://microsoft.com'}
28-Oct-24 17:04:48 - DEBUG - http://localhost:57572 "POST /session/ab1a8c304a979d2230b97c4a5621db00/url HTTP/1.1" 500 0
28-Oct-24 17:04:48 - DEBUG - Remote response: status=500 | data={"value":{"error":"disconnected","message":"disconnected: not connected to DevTools\n  (failed to check if window was closed: disconnected: not connected to DevTools)\n  (Session info: chrome=129.0.6668.100)","stacktrace":"\tGetHandleVerifier [0x00007FF6582DB095+29557]\n\t(No symbol) [0x00007FF65824FA50]\n\t(No symbol) [0x00007FF65810B56A]\n\t(No symbol) [0x00007FF6580F2BAC]\n\t(No symbol) [0x00007FF6580F2A70]\n\t(No symbol) [0x00007FF65810DF31]\n\t(No symbol) [0x00007FF6581A7E49]\n\t(No symbol) [0x00007FF658186F33]\n\t(No symbol) [0x00007FF65815116F]\n\t(No symbol) [0x00007FF6581522D1]\n\tGetHandleVerifier [0x00007FF65860C96D+3378253]\n\tGetHandleVerifier [0x00007FF658658497+3688311]\n\tGetHandleVerifier [0x00007FF65864D1CB+3642539]\n\tGetHandleVerifier [0x00007FF65839A6B6+813462]\n\t(No symbol) [0x00007FF65825AB5F]\n\t(No symbol) [0x00007FF658256B74]\n\t(No symbol) [0x00007FF658256D10]\n\t(No symbol) [0x00007FF658245C1F]\n\tBaseThreadInitThunk [0x00007FFC1695257D+29]\n\tRtlUserThreadStart [0x00007FFC188AAF08+40]\n"}} | headers=HTTPHeaderDict({'Content-Length': '1034', 'Content-Type': 'application/json; charset=utf-8', 'cache-control': 'no-cache'})
28-Oct-24 17:04:48 - DEBUG - Finished Request
28-Oct-24 17:04:48 - ERROR - UNHANDLED MAIN ROUTINE occurred
Traceback (most recent call last):
  File "c:\Users\username\Dropbox\Company\PythonProjects\loop_so_entry\testing-browser.py", line 46, in <module>
    browser.get("http://microsoft.com")
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\webdriver.py", line 363, in get
    self.execute(Command.GET, {"url": url})
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\webdriver.py", line 354, in execute
    self.error_handler.check_response(response)
  File "C:\Program Files\Python312\Lib\site-packages\selenium\webdriver\remote\errorhandler.py", line 229, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: disconnected: not connected to DevTools
  (failed to check if window was closed: disconnected: not connected to DevTools)
  (Session info: chrome=129.0.6668.100)
Stacktrace:
GetHandleVerifier [0x00007FF6582DB095+29557]
(No symbol) [0x00007FF65824FA50]
(No symbol) [0x00007FF65810B56A]
(No symbol) [0x00007FF6580F2BAC]
(No symbol) [0x00007FF6580F2A70]
(No symbol) [0x00007FF65810DF31]
(No symbol) [0x00007FF6581A7E49]
(No symbol) [0x00007FF658186F33]
(No symbol) [0x00007FF65815116F]
(No symbol) [0x00007FF6581522D1]
GetHandleVerifier [0x00007FF65860C96D+3378253]
GetHandleVerifier [0x00007FF658658497+3688311]
GetHandleVerifier [0x00007FF65864D1CB+3642539]
GetHandleVerifier [0x00007FF65839A6B6+813462]
(No symbol) [0x00007FF65825AB5F]
(No symbol) [0x00007FF658256B74]
(No symbol) [0x00007FF658256D10]
(No symbol) [0x00007FF658245C1F]
BaseThreadInitThunk [0x00007FFC1695257D+29]
RtlUserThreadStart [0x00007FFC188AAF08+40]

I'm sure there's a lot of details I haven't addressed, so if there's any questions, please let me know. My brain is sort of fried after spending the day Googling and trying all sorts of different things... Help?!?

Hello everyone, how can i get logs of network fetch calls?

I want to automate posting videos from a folder to youtube. It is going to simply take the video on the local folder, and automate the posting, is this legal to do with selenium?