Web Page Scraping Gems/tools Available In Ruby

I'm trying to scrape web pages in a Ruby script that I'm working on. The purpose of the project is to show which ETFs and stock mutual funds are most compatible with the value inv

Solution 1:

There are so many scraping gems available in Ruby like Hpricot, Nokogiri and so many. I recommend Nokogiri to scrape static web pages. If you are scraping dynamic web pages (means which involves button click, submit form etc..). I recommend Mechanize which internally uses Nokogiri.

Solution 2:

I see a list of HTML parsing solutions at https://www.ruby-toolbox.com/categories/html_parsing.html . I'm going with Nokogiri because it's the only one that's still active.