Anemone

Anemone is a web spider framework that can spider a domain and collect useful information about the pages it visits. It is versatile, allowing you to write your own specialized spider tasks quickly and easily.

See anemone.rubyforge.org for more information.

Features

Examples

See the scripts under the lib/anemone/cli directory for examples of several useful Anemone tasks.

Requirements

Development

To test and develop this gem, additional requirements are:

You will need to have KyotoCabinet, Tokyo Cabinet, MongoDB, and Redis installed on your system and running.