Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - how to run jobs every 30 minutes?


Copy link to this message
-
how to run jobs every 30 minutes?
edward choi 2010-12-07, 08:55
Hi,

I'm planning to crawl a certain web site every 30 minutes.
How would I get it done in Hadoop?

In pure Java, I used Thread.sleep() method, but I guess this won't work in
Hadoop.
Or if it could work, could anyone show me an example?

Ed.