How to use init method in Playwright Python

crawling_{201904307} is not a valid name for a function name in python. Method names can only contain alpha-numeric characters and underscores.

Another way is to simply use the getAttribute() method of the elementHandle to retrieve the value:

handle = page.querySelector('//input[starts-with(@name, "Counter")]')
value = handle.getAttribute("value")

Based on @ggorlen's suggestion, I spotted that the select_option triggered a request, which I was able to trigger on, and validate, thus:

        with page.expect_response(lambda response: response.url) as response_info:
            assert loc[0] in response_info.value.url, f"wrong location {response_info.value.url}, expecting {loc}"

From this page: https://playwright.dev/python/docs/network#variations

But note that there seemed to be a bug on that page as token in in the lambda function isn't relevant. The code checks that the query relates to the address of interest.

Try this:

def main():
    with sync_playwright() as p:
        browser = p.chromium.launch(headless=False)
        context = browser.new_context()
        page = context.new_page()
        page.goto("https://www.aliexpress.com/wholesale?catId=0&initiative_id=AS_20220518080059&SearchText=makeup")
        countrySwitcher = page.query_selector("#switcher-info")
        countrySwitcher.click()
        # time.sleep(6000)
        page.locator("#nav-global > div.ng-item-wrap.ng-item.ng-switcher.active > div > div > div > div.switcher-shipto.item.util-clearfix > div").click()
        page.locator("[placeholder=\"Search\"]").first.click()
        page.locator("[placeholder=\"Search\"]").first.fill("Spain")
        page.locator("li:has-text(\"Spain\")").click()
        page.locator("span:has-text(\"Español\")").click()
        page.locator("text=English").nth(1).click()
        page.locator("span:has-text(\"EUR ( Euro )\")").click()
        page.locator(
            "text=EUR ( Euro ) CHF ( Swiss Franc ) MXN ( Mexican Peso ) EUR ( Euro ) CLP ( Chilean >> [placeholder=\"Search\"]").click()
        page.locator(
            "text=EUR ( Euro ) CHF ( Swiss Franc ) MXN ( Mexican Peso ) EUR ( Euro ) CLP ( Chilean >> [placeholder=\"Search\"]").fill(
            "MAD")
        page.locator("text=MAD ( Moroccan Dirham )").click()
        with page.expect_navigation():
            page.locator("button", has_text="Save").click()


if __name__ == '__main__':
    main()

The problem was that you were searching specifically for the text "Morocco" to be present. It would not have been there if you were from another country since alibaba uses country detection. Your last code line, i.e. page.locator("text=Save").click() was also faulty. The text "Save" resided inside a descendant element which you need to account for.

In general, it is always a good idea to make your locaters as general and flexible as possible to account for minor website changes done by the admin. Therefore, instead of using text to find the elements, maybe you should try using CSS selectors instead?

Further reading

I would do this:

1. Register a listener with expose_function.
2. Use evaluate to register a listener to newPosts. A Listener on the browser side.
3. Inside that listener call the function you exposed on 1.

You have to use inner_text for this:

email = page.locator.inner_text("#cphMain_hlOrgInboundEmail")
print(email)

You are supposed to use sync_playwright as a context managers:

from playwright.sync_api import sync_playwright
print('debug1')

with sync_playwright() as p:
    print('debug2')
    browser = p.firefox.launch(headless=False)
    print('debug3')
    page = browser.new_page()
    page.goto("http://whatsmyuseragent.org/")
    page.screenshot(path="example.png")
    browser.close()

Output

debug1
debug2
debug3

See playwright documentation for python here

Edit (specific to OP)

As a last ditch effort, try these steps in order:

1. Run pip install -U pip
2. Run pip uninstall plawyright
3. Run pip cache remove playwright
4. Run pip install playwright

Keep in mind that if you have installed multiple versions of python, use the PATH variable defined for pip for the version of python you want to install playwright in. Lastly, try changing the browser you use with playwright. So instead of browser = p.firefox.launch(headless=False), use browser = p.chromium.launch(headless=False)

Closing actual popups

I think browser.once("targetcreated", ...) as described in this issue https://stackoverflow.com/a/57246544/2202112 could be something that you are looking for.

It allows you to setup a callback on newly created targets.

For reference, see puppeteer docs on "targetcreated"

Closing modals

1. Find the selector for the button that dismisses the modal, for example .button-close or .button-dismiss.
2. Use the page.click(selector, [options]) method to click the button before continuing further scraping

If you want a Playwright image with Python instead of the Playwright image with Node you have currently set,

do

FROM mcr.microsoft.com/playwright/python:v1.23.0-focal

instead. You won't then need to install python3-pip (or playwright!) at all.

Additionally, you'll probably want to explicitly spell out python3 instead of python:

FROM mcr.microsoft.com/playwright/python:v1.23.0-focal
RUN pip3 install TikTokApi
RUN playwright install
COPY . .