How to use test_should_work_with_noopener_and_url method in Playwright Python

Reading your question I understand that your problem is not the download itself, your problem is the way of clicking the link that you need.

From that moment, you have to options:

1 - You know the date (exact text):

date = "2022-09-26"
with page.expect_download() as download_info:
    page.locator(f"//a[text()='{date}_TEST.zip']").click()
    download = download_info.value
    page.wait_for_url("http://192.xx")
    download_filepath = os.path.join(download_path, suggested_filename)
    download.save_as(download_filepath)
    context.close()
    browser.close()

As you can see you can use f"..{}.." for your locator string in order to use some vars for the locator, basically a locator is a string.

Of course you should know the date before, in my example is hardcoded.

2 - You don't know the date (Contains text):

with page.expect_download() as download_info:
    page.locator(f"//a[contains(text(),'_TEST.zip')]").click()
    download = download_info.value
    page.wait_for_url("http://192.xx")
    download_filepath = os.path.join(download_path, suggested_filename)
    download.save_as(download_filepath)
    context.close()
    browser.close()

And being honest, I think the line page.wait_for_url("http://192.xx") is not needed. Playwright will wait for your download, actually you don't need to wait for the url, I think.

For my examples I used selector with Xpath.

.NET syntax - this worked for me

await page.Locator(":nth-match(:text('your text'), 2)").ClickAsync();

I believe you need to call your go_to_url function using the same recipe:

asyncio.get_event_loop().run_until_complete(go_to_url())

It looks like there is some kind of lazy load, at first, first 8 elements are loaded, if you scroll down, more content will load

Doing something similar for a project of mine, this is how I would do it.

from playwright.sync_api import sync_playwright

posts = ['https://playwright.dev/','https://playwright.dev/python/',]

def scrap_post_info(context, post):
    page = context.new_page()
    page.goto(post)
    print(page.title())
    # do whatever scraping you need to
    page.close()

with sync_playwright() as p:
    browser = p.chromium.launch()
    context = browser.new_context()
    for post in posts:
        scrap_post_info(context, post)
        # some time delay

browser.close()

Thing is the code snippet from the playwright docs is more about opening a new page after clicking a link on an existing page. Since you already have the urls ready, you can just visit each page one by one, and do your scraping.

this worked for me in java:

Page page = browser.newPage();
Map<String, String> headers = new HashMap<>();
headers.put("user-agent", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) `enter code here`AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36");
page.setExtraHTTPHeaders(headers );

Not sure exactly if by "browser to show up" you refer at the fact that you need the browser to not run in headless mode.

There are two possible ways:

1. Install Playwright Test for VSCode as suggest by @MingJie-MSFT. You'll have a Show browser checkbox there in case you want to run your tests headless or not
2. In the config file, for use, add:

headless: false

Example for both options

You need to install browsers by doing playwright install or python -m playwright install see here: https://playwright.dev/python/docs/intro#installation

If you try to perform an action on a label which has associated input element Playwright will automatically retarget the action to the input.

If the DOM structure is always the same you can try something like this

page.locator('div:has( > :text-matches("Project")) + div input')

Otherwise layout selector is your best bet.