Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> Node.js, RabbitMQ, and Accumulo

Copy link to this message
Node.js, RabbitMQ, and Accumulo
A while back, I wrote some code as a proof of concept to use node.js (an
event-driven, server-side Javascript environment) as a way to ingest
data into Accumulo. I think it's a cool example of alternative ways to
get data into Accumulo, so I cleaned up what I wrote and posted it to


Using RabbitMQ (open source message broker which implements the AMQP
standard) and a node.js plugin for AMQP, I was able to send data from a
node.js process, through RabbitMQ, into a background Java process which
inserts the data into Accumulo.

The example is a contrived website hit-tracking application (think
Google Analytics). When a user visits a website, an HTTP request -- with
the client IP, server IP, and current timestamp in the query string --
is made to an HTTP server running inside of the node.js process. This
information then makes its way into Accumulo as a key-value pair.

I hope to expand on this some more, but I wanted to share the existing
concept with everyone. Instructions and additional information can be
found on the project page. Feedback is welcome!

- Josh
Sterling Foster 2012-05-04, 01:42
Josh Elser 2012-05-04, 03:48
William Slacum 2012-05-03, 01:00