How to use not_to_be_checked method in Playwright Python

Just in case you had the same query or were struggling with dynamic web scraping. You have to use CPython and install a webscraper such as Playwright or BS + Selenium

I used playwright which is far more straightforward and has a very much appreciated inner_html() function which reads straight into the dynamic flex HTML code. Here is the code for reference.

#part of the help to write the script I got from https://stackoverflow.com/questions/64303326/using-playwright-for-python-how-do-i-select-or-find-an-element

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch(slow_mo=1000)

    page = browser.new_page()
    page.goto('https://vemcount.app/embed/widget/uOCRuLPangWo5fT')
    central = page.query_selector("p.w-full span");
    print({'central': central.inner_html()})
        
    browser.close()
 

Afterwards I am trying to run the .py script remotely from Grasshopper through a batch file and read the output through a txt or CSV file from within Grasshopper.

If there is a better way I am more than happy to hear your suggestions.

Yours,

A Beginner in Python. :)

I may be wrong on this but let's say the button you are trying to click has link which will redirect you to another page/site and you want to go to that link. You should take the attribute value of the selector and just navigate there. Check here for more details : https://playwright.dev/python/docs/api/class-page#page-get-attribute

Your glob patter for the url is incorrect, should be something like this:

 page.wait_for_url('**/order-received/**')

You can use the select_options for selecting 30.

page.select_option('select#MainContent_ddlRecords', '30')

You can use the text selector and then click the checkboxes like this:

page.locator("text=Tabloul avocaţilor stagiari").click()

I had the same issue as well. I ran this command, then restarted my command line and it started working.

playwright install-deps

I hope this helps.

I would suggest write that returned HTML content to a file and use this to scrape local file using:

import scrapy
import os

LOCAL_FILENAME = 'example.html'
LOCAL_FOLDER = 'html_files'
BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))


class ExampleSpider(scrapy.Spider):
    name = "example"
    start_urls = [
        f"file://{BASE_DIR}/{LOCAL_FOLDER}/{LOCAL_FILENAME}"
    ]

You have to write the page.on("dialog", lambda dialog: dialog.accept()) code before you press on button which is generating the popup. Playwright works with the listner so you should first start listner then click on element which is generating the popup.

page.on("dialog", lambda dialog: dialog.accept())
page.locator(#xyz).click() // Element opening alert window

Have you tried doing what the error instructs you to do: Please complete Playwright installation via running "python -m playwright install"

import requests
import threading

totalRequests = 0
numberOfThreads = 10
threads = [0] * numberOfThreads


def worker(thread):
    r = requests.get("url")
    threads[thread] = 0  # free thread


while totalRequests < 100:
    for thread in range(numberOfThreads):
        if threads[thread] == 0:
            threads[thread] = 1  # occupy thread
            t = threading.Thread(target=worker, args=(thread,))
            t.start()
            totalRequests += 1