%w(map reduce).first - A Tale About Rabbits, Latency, and Slim Crontabs - RailsConf

the talk will present some situations and then the solutions (with code and possible real time demo)

distribute a big batch of local atomic operation across different ruby processes using queues RabbitMQ and the amqp gem, subtitle make some use of your cpu cores

effects of the previous approach applied to systems with high latency as an example it will be shown how to load data in parallel streams in Amazon SimpleDB (the dead_simple_db gem will be shown in the example)

how to convert the time discrete execution dictated by period driven tasks (i.e. *nix crontabs) in a fluid process that consumes entities as soon as they queue and handle smoothly the variance of load this kind of task migt be subject to