How to use async_playwright method in Playwright Python

Found my answer ...

open a second asyncio.ensure_future() with a new definition that asks constantly for new values.

async def read_the_values_from_while_loop():
    while True:
        await asyncio.sleep(5)
        x = classname.value
        print(x)


asyncio.ensure_future(open_browser())
asyncio.ensure_future(read_the_values_from_while_loop())
loop.run_forever()

sorry for my unconcrete question ... was my first ;), try to improve

Your locator should look like this. Replace ":" with ">>"

div[class="some-class"]>>nth=3

Playwright has no method get_by_role.

Try this:

page.locator('link[name="Log in"]').click()

You can give the locator method any CSS or Xpath expression.

for i in range(0, 5):

            html = response.text
            # print(html)
            soup = BeautifulSoup(html, "html.parser")
            search_date = soup.find_all("input")[-6]["value"]
            await page.click(
                "#yDmH0d > c-wiz.zQTmif.SSPGKf > div > div:nth-child(2) > c-wiz > div > c-wiz > div.PSZ8D.EA71Tc > div.Ep1EJd > div > div.rIZzse > div.bgJkKe.K0Tsu > div > div > div.dvO2xc.k0gFV > div > div > div:nth-child(1) > div > div.oSuIZ.YICvqf.kStSsc.ieVaIb > div > div.WViz0c.CKPWLe.U9gnhd.Xbfhhd > button"
            )

            yield {
                "search_date": search_date,
            }

This logic to extract all the dates in the range is incorrect. Understand the flow of

1. you make request to the flight page.
2. you get the response.
3. In parse method you are trying to extract the search date.

search_date = soup.find_all("input")[-6]["value"]

This line is only returning one date and not a list. Moreover, I don't understand the logic behind the for loop here. Because this piece of code is not making any further requests as you are trying to achieve with the extracted dates[mentioned in the question]

Important thing to note here is, you have to got the entire html response in one go. You can now use css selectors or soup to extract all the selected dates. Running the for loop for 5 times, doesn't solve any purpose, as you are executing the same information 5 times.

Use response.css('<<Path to the dates in the select>>').getall() to get all the dates you are looking for. Process the information further.

Improvisation on the logic: You can improvise on the logic, I am not sure why you are extracting range of dates, when you can just extract the departure and return dates for the page. And make a request using them. Or Just extract the departure date and increment it and make another request using that date for further information.

I was able to get the titles of the news articles with the following code:

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
  browser = p.chromium.launch(headless=False)
  page = browser.new_page()
  page.goto('https://blog.coinbase.com/', wait_until='domcontentloaded')
  elements = page.query_selector_all('*[data-post-id]')
  titles = []
  for element in elements:
    try:
      title = element.query_selector('h3 div')
      title = title.text_content()
      if not title in titles:
        titles.append(title)
    except Exception as e:
      continue
  print(titles)

It might not be exactly what you're looking for but hopefully it gets you in the right direction!

Methods in python are snake case. context.add_cookies should do the work.

From what I understand, you have a page that has content within an iframe. You want to use Playwright to access elements within that frame.

The official docs to handle frames: Official docs: https://playwright.dev/docs/frames#frame-objects

You could then try something like this:

// Locate element inside frame
const iframeButton = await page.frameLocator('iFrame').locator("button:has-text(\"Add New User\")");
await iframeButton.click();

Notice that the example has the iFrame tag as locator, but you could and should use something more accurate like and id, name or url.

The best way to do it is using playwright docker image as base image, then you won't need to install its dependencies. Take a look to the documentation here: https://playwright.dev/docs/docker

Another way is to simply use the getAttribute() method of the elementHandle to retrieve the value:

handle = page.querySelector('//input[starts-with(@name, "Counter")]')
value = handle.getAttribute("value")