How to use new_window method of Selenium.WebDriver Package

Perhaps you want to do:

element(:selection) { |id_value, edit_name| browser.div(id: "#{id_value}_#{edit_name.gsub(' ', '%20')}") }

This is creating a selection method that finds a div by id using the known/provided id and name.

The method would be called like:

id_value = 730
edit_name = 'Test Profile'
@site.your_page.selection(id_value, edit_name)

Following @max pleaner advice, you could rescue the exception about not finding the element and then do something with that information. The exception you are looking for in this case is NoSuchElementError.

The code could look like this:

User.all.each do |u|
  driver.navigate.to "http://website.com/" + u.name
  begin
   driver.find_element(:class, "like").click #THIS IS THE LINE THAT SOMETIMES FAILS
  rescue Selenium::WebDriver::Error::NoSuchElementError
    u.error = true
    u.save
  end
end

selenium-webdriver recently released 3.0.0 which defaults to using geckodriver with firefox (which Capybara defaults to), but has some missing functionality in that combination. Rather I would recommend using it with chrome and chromedriver for your use case. You will need to download the latest version of chromedriver and put it somewhere in your PATH. Then

require "capybara/dsl"
require "selenium-webdriver"

Capybara.register_driver :crawler_driver do |app|
  Capybara::Selenium::Driver.new(app, :browser => :chrome)
end
Capybara.default_driver = :crawler_driver

class Crawler
  include Capybara::DSL

  def initialize
    visit "http://www.google.com"
  end
end

crawler = Crawler.new

should do what you're trying to do. You're going to have issues as soon as you create another Crawler instance though since they will both be using the same Capybara session and conflict. If you're not going to be creating multiple instance then you're fine, if you are then you'll want to create a new Capybara::Session in each instance of crawler and call all capybara methods on that session object rather than including Capybara::DSL into your object which would be more like this

class Crawler
  def initialize
    @session = Capybara::Session.new(:crawler_driver)
    @session.visit "http://www.google.com"
  end
end

You didn't specify your Operating system, but for Linux / Mac, you should use RVM, and for Windows I've had success with URU

As rejin suggested, used nokogiri to parse HTML and found CSS links.

doc = Nokogiri::HTML(driver.page_source) 
doc.css('link[rel=stylesheet]').each do |e| 
puts e['href']
end

It's very likely that your file has a byte-order mark U+FEFF at the very beginning. You are probably losing it when you copy and paste again.

The proper solution is:

CSV.foreach("foo.csv", "r:bom|utf-8") { ... }

Just one minor typo in your code, it's not Selenium::Webdriver, but Selenium::WebDriver with capital D.

require 'selenium-webdriver'
require 'test/unit'

class TC_Login < Test::Unit::TestCase
  #@driver = Selenium::Webdriver.for :firefox, yours is Webdriver
  @driver = Selenium::WebDriver.for :firefox
  @driver.get "http:test.com"
end

Port 9515 is the default port for chromedriver, so the connection attempt to 127.0.0.1:9515 is selenium attempting to connect to chromedriver in order to control the browser (Chrome) - The error would tend to indicate that chromedriver isn't starting up correctly. Check you have the latest version of chromedriver installed (or at least one that is compatible with the version of Chrome you're using') and also update selenium-webdriver. If using the chromedriver-helper gem you need to do bundle exec chromedriver -v when checking which version you're actually using since it installs a shim that can end up with you using a different version than it would appear if you just ran chromedriver -v

The issue is your code is actually being executed before the element is finished loading. You need to chain a few methods (namely .when_present and .exists? to ensure your element is loaded before attempting to check it's existence:

puts b.input(:name => "email").when_present.exists?

Good luck!