How to use test_should_output_a_trace method in Playwright Python

Looks like soup is unable to find anything and its returning None and Nonetype has no text property

The error looks here for soup in clothes: as you have overridden the soup parser

---

PS:

You can use get_text() to extract the text

price = soup.find('span', {'class' : 'price'}).get_text()

Sometimes you may have to use contents depending on the return type

price = soup.find('span', {'class' : 'price'}).contents[0]

If you don't want to use context managers then you can start the browser without one using the .start() method:

from playwright.sync_api import sync_playwright

p = sync_playwright().start()
browser = p.chromium.launch(headless=False)
page = browser.new_page()
p.stop()

Remember to use the .stop() method once you are done.

Yes, this is possible! Just create or add to your pytest.ini file which should go in the root of the working directory.

Here is what the pytest.ini file could look like:

# content of pytest.ini
[pytest]
addopts = -v --browser chromium --headed --slowmo 2000

Having --headed in there is what gives you what you want.

Thanks for the question. I'll share what's possible today, and we would be happy to make changes if you could share your scenario as an issue on playwright-python.

playwright-python can work with environment variables like outlined in the linked doc. For example, you can set environment variable for PLAYWRIGHT_BROWSERS_PATH to specify a custom location for your browser binaries.

It is recommended to use Playwright against bundled browser binaries, since Playwright can often depend on browser-side changes that might not be available in older versions. These browser-side changes are done with the intent to improve execution reliability and breadth of Playwright capabilities.

In case you do want to use Playwright against a non-bundled browser binary, you can set the executablePath while launching a browser. For example, the script below launches Edge instead of the bundled Chromium binary.

Python 3.8.0 (default, Sep 21 2020, 12:25:40)
[Clang 12.0.0 (clang-1200.0.32.2)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from playwright import sync_playwright
>>> pw = sync_playwright().start()
>>> browser = pw.chromium.launch(headless=False, executablePath='/Applications/Microsoft Edge Dev.app/Contents/MacOS/Microsoft Edge Dev')

We do not provide browser specific packages like playwright-chromium for Python today, but we are happy to collect feedback on it and make changes.

Your code looks fine. Try the df.iloc[row_start:row_finish,column_start:column_finish] command. It works for me. It may also be a problem with the Jupyter notebook - style running of Playwright. Save this into a file.py and run from the terminal in the correct directory: python file.py

I used asyncio to run Playwright, as I had a template script available, but you should get it working without it too, if you want.

import pandas as pd
import asyncio
from playwright.async_api import Playwright, async_playwright
import pandas as pd

async def run(playwright: Playwright) -> None:
    browser = await playwright.chromium.launch(headless=False, slow_mo=50)
    page = await browser.new_page()
    ## Go to PAPA property address
    await page.goto("https://www.pbcgov.org/papa/Asps/PropertyDetail/PropertyDetail.aspx?parcel=73414434010020070")
    x = await page.content() #You're not using this, so you may as well remove this line.

    ## Click text=View Building Details
    await page.locator("text=View Building Details").click()
    #######################################

    ## Click text=Building 2
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 2").click()
    x2 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    ## Click text=Building 3
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 3").click()
    x3 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    ## Click text=Building 4
    await page.frame_locator("#MainContent_Iframe7").locator("text=Building 4").click()
    x4 = await page.frame_locator("#MainContent_Iframe7").locator("html").inner_html()

    x2s = pd.read_html(x2)
    x3s = pd.read_html(x3)
    x4s = pd.read_html(x4)

    print(x2s[3].iloc[0:,0:]) # When it works this is the table that I want
    print(x3s[3].iloc[0:,0:])
    print(x4s[3].iloc[0:,0:])

    year_built_building_1 = x2s[3].iloc[3][2]
    year_built_building_2 = x3s[3].iloc[3][2]
    year_built_building_3 = x4s[3].iloc[3][2]
    
    print(year_built_building_1,year_built_building_2,year_built_building_3)


async def main(debug=True) -> None:
    async with async_playwright() as playwright:
        await run(playwright)

asyncio.run(main())

On my side it outputs:

                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
                                     1                                   2
0   Structural Element for  Building 1  Structural Element for  Building 1
1                                  NaN                                 NaN
2                      Exterior Wall 1               CONCRETE BLOCK STUCCO
3                           Year Built                                2018
4                  Air Condition Desc.                                 NaN
5                            Heat Type                                NONE
6                            Heat Fuel                                NONE
7                            Bed Rooms                                 NaN
8                           Full Baths                                 NaN
9                           Half Baths                                   1
10                      Roof Structure           WOOD JOISTS, WOOD/COMPOSI
11                          Roof Cover           ALUMINUM/STEEL PANEL ENML
12                     Interior Wall 1                              STABLE
13                        Floor Type 1                         RUBBER TILE
14                             Stories                                   1
2018 2018 2018

You need to install browsers by doing playwright install or python -m playwright install see here: https://playwright.dev/python/docs/intro#installation

At the end of each iteration of "y" you issue a mouse up event. However, you dont issue a mouse move event to the start of the new line before putting the mouse down again.

Try the below code:

    for y in range(100, 1000, 100):
        # Generate mouse points
        points = []
        wm(start_point, y, x, y, M_0=15, D_0=12, move_mouse=lambda x, y: points.append([x, y]))

        page.mouse.up()
        # Move mouse to start of new line
        page.mouse.move(points[0][0], points[0][1])
        # Mouse back down
        page.mouse.down()
        #Iterate the remaining points
        for point in points[1:]:
            page.mouse.move(point[0], point[1])
        page.mouse.up()

You are supposed to use sync_playwright as a context managers:

from playwright.sync_api import sync_playwright
print('debug1')

with sync_playwright() as p:
    print('debug2')
    browser = p.firefox.launch(headless=False)
    print('debug3')
    page = browser.new_page()
    page.goto("http://whatsmyuseragent.org/")
    page.screenshot(path="example.png")
    browser.close()

Output

debug1
debug2
debug3

See playwright documentation for python here

Edit (specific to OP)

As a last ditch effort, try these steps in order:

1. Run pip install -U pip
2. Run pip uninstall plawyright
3. Run pip cache remove playwright
4. Run pip install playwright

Keep in mind that if you have installed multiple versions of python, use the PATH variable defined for pip for the version of python you want to install playwright in. Lastly, try changing the browser you use with playwright. So instead of browser = p.firefox.launch(headless=False), use browser = p.chromium.launch(headless=False)

Playwright has no method get_by_role.

Try this:

page.locator('link[name="Log in"]').click()

You can give the locator method any CSS or Xpath expression.