Prosperative Public Forum

Forum Scraper

0 Members and 1 Guest are viewing this topic.

Forum Scraper
« on: June 17, 2010, 09:40:33 AM »
How about a tool that scrapes forums for information? Type in a keyword, find forums dealing with that keyword. Join those forums and set the tool to monitor them for topics you're watching.

Maybe run Answer Analyst to come up with the questions you should be asking, run those questions through AA to grab what you can then run the forum tool to search dozens or hundreds of forums with one click for answers not found anywhere else.

Some folks might suggest combing the two operations but a forum watcher could be set to update any given keyword as soon as someone posts to a forum being watched. Forums are far more dynamic then static pages.

The great thing about forums are they give a researcher insights into what folks are thinking and sharing in real time. Plus, you can ask questions to things you are researching.

Some forums may email you whenever they are updated but what if you could have dozens of forums you're watching deliver that information into a program that could then be processed further from there? For a marketer the most important element of forums is finding out what questions people are asking. Answering those questions correctly is where the money is to be found.

Do your research then post to those same forums to drive people to your solutions.

"Very powerfull stuff".  8)
« Last Edit: June 17, 2010, 09:44:26 AM by Tradeview »
Explosive Leads Generation.. More than 70,000 marketers use this one powerful system. Why?http://www.leadsleap.com/?r=tradeview

Offline Jonathan Leger

  • *****
  • 8863
  • Here's to your success!
    • View Profile
    • Jonathan Leger's Blog
Re: Forum Scraper
« Reply #1 on: June 17, 2010, 10:41:36 AM »
Interesting timing Tradeview.  I've actually been thinking about this myself just yesterday, and running a few tests on Google.  As it turns out it's pretty simple to find new threads on your subject area from forums using Google's own filtering -- but it's a manual process, and tedious to click-through every new thread to try and find questions people are asking.

It would be cool to have a tool that scans Google for new threads and new questions and presents you with a list of what's being asked with a link to the thread.  Maybe even grouping similar questions together so you can see what questions are very popular at the time.

Hmm....

Offline Jonathan Leger

  • *****
  • 8863
  • Here's to your success!
    • View Profile
    • Jonathan Leger's Blog
Re: Forum Scraper
« Reply #2 on: June 17, 2010, 10:45:11 AM »
Oh, another reason a tool like this would be highly beneficial is because it would give the user the ability to go to each forum where questions are being asked and display his expertise by answering the question.

That would result in traffic to his signature links plus increase backlinks to his sites for SEO purposes, on top of establishing him as an authority at that site on the subject (which is priceless).

Re: Forum Scraper
« Reply #3 on: June 17, 2010, 01:12:19 PM »
Oh, another reason a tool like this would be highly beneficial is because it would give the user the ability to go to each forum where questions are being asked and display his expertise by answering the question.

That would result in traffic to his signature links plus increase backlinks to his sites for SEO purposes, on top of establishing him as an authority at that site on the subject (which is priceless).

That's what I'd call, "cooking with real butter"... excellent points Jon.  8)
« Last Edit: June 17, 2010, 01:16:08 PM by Tradeview »
Explosive Leads Generation.. More than 70,000 marketers use this one powerful system. Why?http://www.leadsleap.com/?r=tradeview

Re: Forum Scraper
« Reply #4 on: June 29, 2010, 06:01:26 AM »
Jon, your last blog post was very close to what I'm after. I took up your suggestion and I really, really appreciate the info!

Now imagine having software that could monitor and organize dozens (hundreds?) of forums for the keywords of interest. Maybe, just thinking out loud here, weed out duplicate data and cut it all down to the chase. Run that data through AA or IAW to come up with answers (and probably a lot more questions!).

Take my suggestion for an Article Formater... type in a headline, a starting sentence (or two) and the data collected. Click "Format", let it spin a bit and with the gods on our sides .... spit out a dozen or so suggestions for articles! Work them over with a broom to clean them up a bit and we have fresh new articles, each with a completely new structure to them.

Hey, a guy can dream can't he?  8)
Explosive Leads Generation.. More than 70,000 marketers use this one powerful system. Why?http://www.leadsleap.com/?r=tradeview

Offline snm

  • *****
  • 849
    • View Profile
    • Buy Pre Spun Articles- Spin Ready, Spinnable Articles
Re: Forum Scraper
« Reply #5 on: June 29, 2010, 06:26:49 AM »
Doesn't Google Alerts already allow you to monitor forums based on keywords?

Regards
SNM

Re: Forum Scraper
« Reply #6 on: June 29, 2010, 06:33:34 AM »
Doesn't Google Alerts already allow you to monitor forums based on keywords?

Regards
SNM

yes, but as Jon points out its manual and a pain in the butt to look through dozens of postings to come up with what you might be looking for.
Explosive Leads Generation.. More than 70,000 marketers use this one powerful system. Why?http://www.leadsleap.com/?r=tradeview

Offline snm

  • *****
  • 849
    • View Profile
    • Buy Pre Spun Articles- Spin Ready, Spinnable Articles
Re: Forum Scraper
« Reply #7 on: June 29, 2010, 07:00:45 AM »
Jon may be right but G Alerts and Gmail combined may be useful.

Regards
SNM

Re: Forum Scraper
« Reply #8 on: June 29, 2010, 07:03:31 AM »
Jon may be right but G Alerts and Gmail combined may be useful.

Regards
SNM

That's what I'm using now.. after reading Jon's blog. But I think we can improve it with software. Just an idea.
Explosive Leads Generation.. More than 70,000 marketers use this one powerful system. Why?http://www.leadsleap.com/?r=tradeview