1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
|
[presque](http://github.com/franckcuny/presque/tree/) is a small message queue service build on top of [redis](http://code.google.com/p/redis/) and [Tatsumaki](http://search.cpan.org/perldoc?Tatsumaki). It's heavily inspired by [RestMQ](http://github.com/gleicon/restmq) and [resque](http://github.com/defunkt/resque).
- Communications are done in JSON over HTTP
- Queues and messages are organized as REST resources
- A worker can be writen in any language that make a HTTP request and read JSON
- Thanks to redis, the queues are persistent
Overview
--------
resque need a configuration file, writen in YAML that contains the host and port for the Redis server.
``` example
redis:
host: 127.0.0.1
port: 6379
```
Let's start the server:
``` example
% plackup app.psgi --port 5000
```
The applications provides some HTTP routes:
- **/**: a basic HTML page with some information about the queues
- ***q***: REST API to get and post job to a queue
- ***j***: REST API to get some information about a queue
- ***control***: REST API to control a queue (start or stop consumers)
- ***stats***: REST API to fetch some stats (displayed on the index page)
Queues are created on the fly, when a job for an unknown queue is inserted. When a new job is created, the JSON send in the POST will be stored "as is". There is no restriction on the schema or the content of the JSON.
Creating a new job simply consist to :
``` example
% curl -X POST "http://localhost:5000/q/foo" -d '{"foo":"bar", "foo2":"bar" }'
```
and fetching the job:
``` example
% curl "http://localhost:5000/q/foo"
```
When a job is fetched, it's removed from the queue.
A basic worker
--------------
I've also pushed [presque::worker](http://git.lumberjaph.net/p5-presque-worker.git/). It's based on [AnyEvent::HTTP](http://search.cpan.org/perldoc?AnyEvent::HTTP) and [Moose](http://search.cpan.org/perldoc?Moose). Let's write a basic worker using this class:
``` perl
use strict;
use warnings;
use 5.012; # w00t
package simple::worker;
use Moose;
extends 'presque::worker';
sub work {
my ($self, $job) = @_;
say "job's done";
...; # yadda yadda!
return;
}
package main;
use AnyEvent;
my $worker =
simple::worker->new(base_uri => 'http://localhost:5000', queue => 'foo');
AnyEvent->condvar->recv;
```
A worker have to extends the presque::worker class, and implement the method *work*. When the object is created, the class check if this method is avalaible. You can also provide a `fail` method, which will be called when an error occur.
The future
----------
I plan to add support for [websocket](http://en.wikipedia.org/wiki/WebSocket), and probably [XMPP](http://en.wikipedia.org/wiki/Xmpp). More functionalities to the worker too: logging, forking, handling many queues, ... I would like to add priorities to queue also, and maybe scheluding job for a given date (not sure if it's feasable with Redis).
|
