How to use test_jshandle_properties_get_property method in Playwright Python

Turns out I was close, but to get the iframe correctly, I needed to call the contentFrame() method.

Returns the content frame for element handles referencing iframe nodes, or null otherwise

Then, querySelector() will return the respective elementHandle just fine:

with sync_playwright() as p:
    for browser_type in [p.chromium, p.firefox, p.webkit]:
        browser = browser_type.launch(headless=False)
        page = browser.newPage()
        page.goto('https://www.w3schools.com/tags/tryit.asp?filename=tryhtml_option')
        iframe = page.querySelector('iframe').contentFrame()
        element = iframe.querySelector('select')
        print(type(element))
        print(element.innerHTML())
        browser.close()

successfully prints

<class 'playwright.sync_api.ElementHandle'>

  <option value="volvo">Volvo</option>
  <option value="saab">Saab</option>
  <option value="opel">Opel</option>
  <option value="audi">Audi</option>

Note: if there are multiple iframes, you can just use an attribute when retrieving the handle. To get the iframe by its id in the above example, e.g. use

iframe = page.querySelector('iframe[id=\"iframeResult\"]').contentFrame()

You do not need to save the image to a file at all (cmp. screenshot documentation), but instead can simply store it in a variable, like img = page.screenshot(). You can then pass that variable to your REST request. I use the requests module in the example below, the POST request is simplified and may require some additional parameters (depending on your API) or for instance different URLs for the different browser types:

from playwright import sync_playwright
import requests

with sync_playwright() as p:
    for browser_type in [p.chromium, p.firefox, p.webkit]:
        browser = browser_type.launch()
        page = browser.newPage()
        page.goto('https://scrapingant.com/')
        # save screenshot to var
        img = page.screenshot() 
        # pass var directly to your request
        files = {'image': img, 'content-type': 'image/png'}
        requests.post('http://yourresturl.com', files=files)
        browser.close()

If you really wanted to save the image to a temporary file for some reason (which, as I understand your use case, is not really necessary), you could e.g. use the tempfile module and create a named temporary file (cmp. How to use tempfile.NamedTemporaryFile()?):

from playwright import sync_playwright
import tempfile
import requests

tf = tempfile.NamedTemporaryFile(suffix='.png')

with sync_playwright() as p:
    for browser_type in [p.chromium, p.firefox, p.webkit]:
        browser = browser_type.launch()
        page = browser.newPage()
        page.goto('https://scrapingant.com/')
        # save screenshot to temporary file
        page.screenshot(path=tf.name)
        # send request loading temporary file
        requests.post('http://myresturl.com', {'media': open(tf.name, 'rb')})
        browser.close()        

# close temporary file
tf.close()

Try this:

if (page.is_visible(XPATH)):
    page.click(XPATH)

Or you can make the code cleaner like this:

try:
    page.click(XPATH)
except:
    pass

In your special case, each page has their own link. It is your base link and the page number with an hyphen (-) in between.

You can see this behaviour when clicking on the second page, compare your base-link with the link you have now: https://forum.donanimhaber.com/turkcell-25-000-dk-12-000-sms-70-gb-internet-12-ay-320-tl-ana-konu--151777938-2

(notice the -2 at the end)

One way to do it, would be to change your url in a for-loop, iterating up to 24 and scrape all of those pages individually.

They are saved in the same way, but in the second case you are overwriting the variable with return value of .screenshot method, which seems to be of the type bytes

I had the same issue as well. I ran this command, then restarted my command line and it started working.

playwright install-deps

I hope this helps.

You cannot use page.click for elements which are on a different page (in an iframe). You need to get a handle on the frame and interact with that.

Something like:

frame = page.frame(name="frame-name")
frame.click("the selector of the element you want to click inside the frame")

Something which might give you some inspiration for the correct selectors and so on is the codegen feature of Playwright. From the docs though, it looks like it generates JavaScript so really only for inspiration.

(P.S. No experience with Python here)

The best way to do it is using playwright docker image as base image, then you won't need to install its dependencies. Take a look to the documentation here: https://playwright.dev/docs/docker

Just use some condition instead of print method, for example you could check if response contains some key in its json:

def run(playwright):
    chromium = playwright.chromium
    browser = chromium.launch()
    page = browser.new_page()
    # Subscribe to "request" and "response" events.
    page.on("request", lambda request: print(">>", request.method, request.url))
    page.on("response", lambda response: print("<<", response.status, response.url))
    page.goto("https://example.com")
    browser.close()

For Example:

page.on("response", lambda response: response if key in response.body())

There should be waitForResponse for python too, and you could use that.