How to use test_should_return_empty_body method in Playwright Python

Your glob patter for the url is incorrect, should be something like this:

 page.wait_for_url('**/order-received/**')

Playwright has a built in code generator which will make things easy for you.

Run this command and try it out

npx playwright codegen

You can not interact with extensions in playwright. You could script windows tasks like clicking, waiting, pressing keys etc and run it with headfull browser mode.

for i in range(0, 5):

            html = response.text
            # print(html)
            soup = BeautifulSoup(html, "html.parser")
            search_date = soup.find_all("input")[-6]["value"]
            await page.click(
                "#yDmH0d > c-wiz.zQTmif.SSPGKf > div > div:nth-child(2) > c-wiz > div > c-wiz > div.PSZ8D.EA71Tc > div.Ep1EJd > div > div.rIZzse > div.bgJkKe.K0Tsu > div > div > div.dvO2xc.k0gFV > div > div > div:nth-child(1) > div > div.oSuIZ.YICvqf.kStSsc.ieVaIb > div > div.WViz0c.CKPWLe.U9gnhd.Xbfhhd > button"
            )

            yield {
                "search_date": search_date,
            }

This logic to extract all the dates in the range is incorrect. Understand the flow of

1. you make request to the flight page.
2. you get the response.
3. In parse method you are trying to extract the search date.

search_date = soup.find_all("input")[-6]["value"]

This line is only returning one date and not a list. Moreover, I don't understand the logic behind the for loop here. Because this piece of code is not making any further requests as you are trying to achieve with the extracted dates[mentioned in the question]

Important thing to note here is, you have to got the entire html response in one go. You can now use css selectors or soup to extract all the selected dates. Running the for loop for 5 times, doesn't solve any purpose, as you are executing the same information 5 times.

Use response.css('<<Path to the dates in the select>>').getall() to get all the dates you are looking for. Process the information further.

Improvisation on the logic: You can improvise on the logic, I am not sure why you are extracting range of dates, when you can just extract the departure and return dates for the page. And make a request using them. Or Just extract the departure date and increment it and make another request using that date for further information.

Looks like soup is unable to find anything and its returning None and Nonetype has no text property

The error looks here for soup in clothes: as you have overridden the soup parser

PS:

You can use get_text() to extract the text

price = soup.find('span', {'class' : 'price'}).get_text()

Sometimes you may have to use contents depending on the return type

price = soup.find('span', {'class' : 'price'}).contents[0]

Another way is to simply use the getAttribute() method of the elementHandle to retrieve the value:

handle = page.querySelector('//input[starts-with(@name, "Counter")]')
value = handle.getAttribute("value")

Playwright's default timer is 30 seconds. So in the try part, it tries for 30 seconds to get the series, but there is none, so after 30 seconds only, it goes to the exception.

You can set a custom timout when calling inner_text().

See: https://playwright.dev/python/docs/api/class-locator#locator-inner-text

From what I understand, you have a page that has content within an iframe. You want to use Playwright to access elements within that frame.

The official docs to handle frames: Official docs: https://playwright.dev/docs/frames#frame-objects

You could then try something like this:

// Locate element inside frame
const iframeButton = await page.frameLocator('iFrame').locator("button:has-text(\"Add New User\")");
await iframeButton.click();

Notice that the example has the iFrame tag as locator, but you could and should use something more accurate like and id, name or url.

Use a for loop to iterate over dictionary contained in cookies and check if it contains name which has value equal to "auth_token" or not, if it does then access the "value" key of that dictionary.

with open('t.json') as f:
    content = json.load(f)
    cookies = content['cookies']
    
    for data in cookies:
        if data['name'] == 'auth_token':
            auth_token = data['value']
    
    print(auth_token)