Improved URL Scraper Results

Tonight I was building a PPV campaign for an email submit and suddenly got a bunch of doubles and bad urls in my batch URL scraper so I broke out Visual Studio and got to work on an upgrade. Now the filter will catch bad urls that have “…” in them AND sorts by url alphabetically then removes doubles.

Now, I had to compromise and make every url lowercase b/c it was treating Match.com as being different than match.com. That’s ok for now since my favorite PPV network, Traffic Vance, is not case sensitive. If that changes so will the scraper.

So now the scraped URLs take less work to make a nice profitable keyword list.

Enjoy…

Tags: Development, keywords, url scraper