How to use test_should_get_cookies_from_multiple_urls method in Playwright Python

You should follow the Page Object Model Architecture: https://playwright.dev/python/docs/pom

Example of project

conftest.py
pom/
--login/
----login_page.py --> In this file we will have all selectors for login page and the basic functions for each element, like fill_user, fill_password, click_login_button etc.
--search/
----search_page.py --> In this file we will have all selectors for search page and the basic functions for each element, like fill_search_bar, click_search_button etc.
tests/
--login/
----test_login.py --> In this file we will use the methods that login_page.py contains like (fill_user, fill_password, click_login_button)
--search/
---- test_search.py --> In this file we will use the methods that login_page.py contains and methods that search_page.py contains (fill_search_bar, click_search_button)

If you don't want to use context managers then you can start the browser without one using the .start() method:

from playwright.sync_api import sync_playwright

p = sync_playwright().start()
browser = p.chromium.launch(headless=False)
page = browser.new_page()
p.stop()

Remember to use the .stop() method once you are done.

Step 1: make sure you're in Linux Container in Docker.

Step 2: Go to C:\Users\[User Name]\.docker\config.json Replace credsStore to credStore

Step 3: create Dockerfile, .dockerignore and docker-compose.yml file

Step 4: docker-compose format.

version: "3.9"
services:
frontend:
build: .
ports:
  - "8000:80"
backend:
image: "mcr.microsoft.com/mssql/server"
environment:
  SA_PASSWORD: "Docker123!"
  ACCEPT_EULA: "Y"
ports:
  - "1440:1433"

try to use sam ports as I mentioned here. User = sa, Database = master It will run perfectly fine. IA.

OK, I figured out the way to check. Apparently if I go to the url which I can access when I am logged in, it will stay in that url. If not logged in, it will redirect me to the login page. Now, I just check page.url.

So I found a working solution.

What I did was to combine Javascript with python Playwright code.

I start the setInterval with a timer of 200ms to scroll down on the page with page.evaluate() and then I follow it up with a python loop that checks every second whether the total height of the page (scroll included) has changed. If it changes it continues to scroll and if it hasn't changed than the scroll is over.
This is what it looks like:

page.evaluate(
    """
    var intervalID = setInterval(function () {
        var scrollingElement = (document.scrollingElement || document.body);
        scrollingElement.scrollTop = scrollingElement.scrollHeight;
    }, 200);

    """
)
prev_height = None
while True:
    curr_height = page.evaluate('(window.innerHeight + window.scrollY)')
    if not prev_height:
        prev_height = curr_height
        time.sleep(1)
    elif prev_height == curr_height:
        page.evaluate('clearInterval(intervalID)')
        break
    else:
        prev_height = curr_height
        time.sleep(1)

EDIT

See the below answer using the new mouse.wheel(x, y) feature for an up to date way to scroll using playwright. Combine my answer with his to lessen the need to use JS.

Closing actual popups

I think browser.once("targetcreated", ...) as described in this issue https://stackoverflow.com/a/57246544/2202112 could be something that you are looking for.

It allows you to setup a callback on newly created targets.

For reference, see puppeteer docs on "targetcreated"

Closing modals

1. Find the selector for the button that dismisses the modal, for example .button-close or .button-dismiss.
2. Use the page.click(selector, [options]) method to click the button before continuing further scraping

Instead of page.wait_for_timeout(5000), you can write an expect assertion, which has a default timeout of 5 seconds.

locator = page.locator("//input[@type="checkbox"]")
expect(locator).to_be_checked()

Or, if you want to increase the timeout you can do this:

locator = page.locator("//input[@type="checkbox"]")
expect(locator).to_be_checked(timeout=7000)

I have come up with a solution in Node js puppeteer and I think it work the same way in python. As far as why the button isn't being pressed, I have no idea. But, what does work is entering an address and then clicking the first address suggestion.

Here is my code:

const puppeteer = require('puppeteer');
async function start(){
    const browser = await puppeteer.launch()
    const page = await browser.newPage()
    await page.goto("https://www.ubereats.com/ca")
    await page.type("#location-typeahead-home-input", "Address")
    await page.waitForSelector('#location-typeahead-home-item-0');
    await page.click("#location-typeahead-home-item-0")
    await page.waitForNavigation()

    console.log(page.url())
    await browser.close()
}

start()

I found that it's possible to use Page in context of exposed function, as long as:

1. You use async Playwright (as per @hardkoded suggestion)
2. Don't navigate away (as per @Charchit suggestion)

from playwright.async_api import  Page, async_playwright
import asyncio
from functools import partial
import time


async def handle_title(page: Page, title: str):
    # page = page_var.get()
    print(page)
    await page.locator("#searchInput").type(f"{title}")
    return "hello world"


async def main():
     async with async_playwright() as p:
        browser = await p.chromium.launch(headless=False)
        context = await browser.new_context(viewport={ 'width': 1920, 'height': 1024 })
        page = await context.new_page()
        await page.goto(f"https://wikipedia.org")
        await context.expose_function("handle_title", partial(handle_title, page))
        await page.evaluate("window.onload = () => handle_title(document.title)")
        while True:
            await asyncio.sleep(1)



asyncio.run(main())