tadeuszwojcik / luvit-redis Goto Github PK

fast luvit redis client

Home Page: http://tadeuszwojcik.github.io/luvit-redis/

Lua 38.84% JavaScript 27.64% C 33.53%

luvit-redis's Introduction

luvit-redis - fast luvit redis client.

This is a redis client for luvit which under the hood uses offical hiredis c library what makes it pretty fast (see benchmarks below).

Installation

from git

git clone https://github.com/twojcik/luvit-redis
make

Usage

Simple example, included as examples/exampe.lua:

local redis = require('redis')

local client = redis:new()

client:on("error", function (err)
    print("Error (error callback): ", err)
end)

client:set('test-key','luvit-rocks', redis.print)
client:hset("hash key", "hashtest 1", "some value", redis.print)
client:hset("hash key", "hashtest 2", "some other value", redis.print)
client:hkeys("hash key", function (err, replies)
    print(#replies.." replies:")
    for i,v in ipairs(replies) do print(i,v) end
end)

This will display:

tadek@ubuntudev:~/Projects/luvit-redis$ luvit examples/example.lua
Reply:  OK
Reply:  0
Reply:  0
2 replies:
1 hashtest 1
2 hashtest 2

Benchmarks

Comparison of `node-redis` and `luvit-redis`.

Summary: `luvit-redis` is about 3x to 13x faster than `node-redis`.

Benchmark performed on single box( on Intel I7 i920).

`luvit-redis` (benchmark.lua)

x/yy x - pipeline size, yy - num of clients

          PING        1/10  5.411s total,   18481.98 ops/sec
          PING       50/10  0.511s total,  195546.21 ops/sec
          PING      200/10  0.311s total,  321286.15 ops/sec
          PING    20000/10  0.230s total,  435159.23 ops/sec
          PING    50000/10  0.221s total,  453050.36 ops/sec
          PING   100000/10  0.209s total,  477336.03 ops/sec
 SET small str        1/10  5.791s total,   17266.72 ops/sec
 SET small str       50/10  0.541s total,  184797.48 ops/sec
 SET small str      200/10  0.338s total,  295445.51 ops/sec
 SET small str    20000/10  0.249s total,  401343.46 ops/sec
 SET small str    50000/10  0.241s total,  415111.58 ops/sec
 SET small str   100000/10  0.276s total,  362384.55 ops/sec
 GET small str        1/10  5.528s total,   18090.44 ops/sec
 GET small str       50/10  0.538s total,  186025.01 ops/sec
 GET small str      200/10  0.332s total,  301571.67 ops/sec
 GET small str    20000/10  0.245s total,  407369.81 ops/sec
 GET small str    50000/10  0.234s total,  427156.81 ops/sec
 GET small str   100000/10  0.222s total,  450142.26 ops/sec
 SET large str        1/10  6.022s total,   16606.71 ops/sec
 SET large str       50/10  0.729s total,  137158.40 ops/sec
 SET large str      200/10  0.543s total,  184146.14 ops/sec
 SET large str    20000/10  0.460s total,  217493.53 ops/sec
 SET large str    50000/10  0.755s total,  132451.57 ops/sec
 SET large str   100000/10  0.889s total,  112432.06 ops/sec
 GET large str        1/10  6.319s total,   15825.11 ops/sec
 GET large str       50/10  1.372s total,   72890.50 ops/sec
 GET large str      200/10  1.221s total,   81922.56 ops/sec
 GET large str    20000/10  1.252s total,   79886.88 ops/sec
 GET large str    50000/10  1.146s total,   87288.52 ops/sec
 GET large str   100000/10  0.848s total,  117871.43 ops/sec
          INCR        1/10  5.524s total,   18103.14 ops/sec
          INCR       50/10  0.528s total,  189301.07 ops/sec
          INCR      200/10  0.327s total,  305526.24 ops/sec
          INCR    20000/10  0.240s total,  416123.88 ops/sec
          INCR    50000/10  0.232s total,  431203.55 ops/sec
          INCR   100000/10  0.246s total,  407282.39 ops/sec
         LPUSH        1/10  5.518s total,   18123.52 ops/sec
         LPUSH       50/10  0.530s total,  188726.54 ops/sec
         LPUSH      200/10  0.331s total,  301726.57 ops/sec
         LPUSH    20000/10  0.250s total,  399644.79 ops/sec
         LPUSH    50000/10  0.244s total,  409599.60 ops/sec
         LPUSH   100000/10  0.249s total,  401584.01 ops/sec
     LRANGE 10        1/10  6.479s total,   15435.33 ops/sec
     LRANGE 10       50/10  0.781s total,  128076.22 ops/sec
     LRANGE 10      200/10  0.548s total,  182371.91 ops/sec
     LRANGE 10    20000/10  0.538s total,  185805.23 ops/sec
     LRANGE 10    50000/10  0.504s total,  198485.58 ops/sec
     LRANGE 10   100000/10  0.576s total,  173646.70 ops/sec
    LRANGE 100        1/10 10.582s total,    9449.91 ops/sec
    LRANGE 100       16/10  2.754s total,   36309.17 ops/sec
    LRANGE 100      200/10  2.581s total,   38743.34 ops/sec
    LRANGE 100    20000/10  4.245s total,   23558.74 ops/sec
    LRANGE 100    50000/10  4.593s total,   21772.32 ops/sec
    LRANGE 100   100000/10  5.079s total,   19687.76 ops/sec

`node-redis` (multi_bench.js)

x/yy x- pipeline size, yy - num of clients

Client count: 10, node version: 0.7.6, server version: 2.9.6
parser: hiredis

          PING        1/10  5549ms total, 18021.27 ops/sec
          PING       50/10  3385ms total, 29542.10 ops/sec
          PING      200/10  3304ms total, 30266.34 ops/sec
          PING    20000/10  3254ms total, 30731.41 ops/sec
          PING    50000/10  3313ms total, 30184.12 ops/sec
          PING   100000/10  3023ms total, 33079.72 ops/sec
 SET small str        1/10  6709ms total, 14905.35 ops/sec
 SET small str       50/10  3550ms total, 28169.01 ops/sec
 SET small str      200/10  3272ms total, 30562.35 ops/sec
 SET small str    20000/10  3387ms total, 29524.65 ops/sec
 SET small str    50000/10  3356ms total, 29797.38 ops/sec
 SET small str   100000/10  2974ms total, 33624.75 ops/sec
 GET small str        1/10  6967ms total, 14353.38 ops/sec
 GET small str       50/10  3286ms total, 30432.14 ops/sec
 GET small str      200/10  3350ms total, 29850.75 ops/sec
 GET small str    20000/10  3620ms total, 27624.31 ops/sec
 GET small str    50000/10  3361ms total, 29753.05 ops/sec
 GET small str   100000/10  2793ms total, 35803.80 ops/sec
 SET large str        1/10  8355ms total, 11968.88 ops/sec
 SET large str       50/10  3723ms total, 26860.06 ops/sec
 SET large str      200/10  3558ms total, 28105.68 ops/sec
 SET large str    20000/10  3761ms total, 26588.67 ops/sec
 SET large str    50000/10  3776ms total, 26483.05 ops/sec
 SET large str   100000/10  3575ms total, 27972.03 ops/sec
 GET large str        1/10  8859ms total, 11287.96 ops/sec
 GET large str       50/10  3858ms total, 25920.17 ops/sec
 GET large str      200/10  3776ms total, 26483.05 ops/sec
 GET large str    20000/10  4191ms total, 23860.65 ops/sec
 GET large str    50000/10  4013ms total, 24919.01 ops/sec
 GET large str   100000/10  3441ms total, 29061.32 ops/sec
          INCR        1/10  6517ms total, 15344.48 ops/sec
          INCR       50/10  3398ms total, 29429.08 ops/sec
          INCR      200/10  3183ms total, 31416.90 ops/sec
          INCR    20000/10  3160ms total, 31645.57 ops/sec
          INCR    50000/10  2992ms total, 33422.46 ops/sec
          INCR   100000/10  2989ms total, 33456.01 ops/sec
         LPUSH        1/10  6105ms total, 16380.02 ops/sec
         LPUSH       50/10  3268ms total, 30599.76 ops/sec
         LPUSH      200/10  3073ms total, 32541.49 ops/sec
         LPUSH    20000/10  3280ms total, 30487.80 ops/sec
         LPUSH    50000/10  3299ms total, 30312.22 ops/sec
         LPUSH   100000/10  2903ms total, 34447.12 ops/sec
     LRANGE 10        1/10  8596ms total, 11633.32 ops/sec
     LRANGE 10       50/10  3643ms total, 27449.90 ops/sec
     LRANGE 10      200/10  3427ms total, 29180.04 ops/sec
     LRANGE 10    20000/10  3734ms total, 26780.93 ops/sec
     LRANGE 10    50000/10  3720ms total, 26881.72 ops/sec
     LRANGE 10   100000/10  3899ms total, 25647.60 ops/sec
    LRANGE 100        1/10 14431ms total,  6929.53 ops/sec
    LRANGE 100       50/10  5416ms total, 18463.81 ops/sec
    LRANGE 100      200/10  5310ms total, 18832.39 ops/sec
    LRANGE 100    20000/10  5499ms total, 18185.12 ops/sec
    LRANGE 100    50000/10  5728ms total, 17458.10 ops/sec
    LRANGE 100   100000/10  5392ms total, 18545.99 ops/sec

Sending Commands

Each Redis command is exposed as a function on the client object. All functions take variable number of individual arguments followed by an optional callback.

Example:

client:mset("test keys 1", "test val 1", "test keys 2", "test val 2", function (err, res) end)

For a list of Redis commands, see Redis Command Reference

The commands can be specified in uppercase or lowercase for convenience, client:get() is the same as client:GET().

API

Connection events

client object will emit some events about the state of the connection to the Redis server.

"connect"

client will emit connect event when first write event is received (stream is connected to redis).

"disconnect"

client will emit disconnect event when connection is disconnected (per user request).

"error"

client will emit error when encountering an error with connection to the Redis server.

Note that "error" is a special event type in luvit. If there are no listeners for an "error" event, luvit will exit.

redis:new(port, host, autoReconnect)

Create a new client connection. port defaults to 6379 and host defaults to 127.0.0.1. If you have redis-server running on the same computer as luvit, then the defaults for port and host are probably fine.

autoReconnect

luvi-redis has autoReconnect functionality to redis-sever build in. You can turn it off by setting 'autoReconnect' to false.

(TODO: add more explanation how it works.)

client:registerCommand(...)

(todo)

client:command(...)

(todo)

client:disconnect()

When this function is called, the connection is not immediately terminated. Instead, new commands are no longer accepted and the connection is only terminated when all pending commands have been written to the socket, their respective replies have been read and their respective callbacks have been executed.

redis.print()

A handy callback function for displaying return values when testing.

new() returns a RedisClient object that is named client in all of the examples here.

TODO

apply fixes according to @DVV review comments
unit tests
improve docs
more examples
client auth
c optimizations ?

Contributors

[Tadeusz Wójcik] (https://github.com/twojcik)
Vladimir Dronnikov

Credits

Thanks to Salvatore Sanfilippo for creating Redis in first place and hiredis driver, Matt Ranney for creating node-redis, Alexander Gladysh for creating lua hiredis, Tim Caswell for creating luvit, and Vladimir Dronnikov for all help as without him that module would never happen. Thank you all!

License

(The MIT License)

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

luvit-redis's People

Contributors

Stargazers

Watchers

Forkers

4z3 rjemanuele dirtyice gsick notxarb develephant

luvit-redis's Issues

Publish to NPM

Did you know that latest version 0.8.2 allows using NPM as package manager?
https://github.com/luvit/luvit/blob/master/ChangeLog#L31

Cannot build

make fails with message

mkdir -p build
cc Usage: luvit [options] script.lua [arguments]    Options:     -h, --help          Print this help screen.     -v, --version       Print the version.     -e code_chunk       Evaluate code chunk and print result.     -i, --interactive   Enter interactive repl after executing script.     -n, --no-color      Disable colors.     -c, --16-colors     Use simple ANSI colors     -C, --256-colors    Use 256-mode ANSI colors                         (Note, if no script is provided, a repl is run instead.)    -Ideps/hiredis -Isrc -o build/redis.luvit src/redis.c deps/hiredis/libhiredis.a Usage: luvit [options] script.lua [arguments]    Options:     -h, --help          Print this help screen.     -v, --version       Print the version.     -e code_chunk       Evaluate code chunk and print result.     -i, --interactive   Enter interactive repl after executing script.     -n, --no-color      Disable colors.     -c, --16-colors     Use simple ANSI colors     -C, --256-colors    Use 256-mode ANSI colors                         (Note, if no script is provided, a repl is run instead.)    deps/hiredis/libhiredis.a
/bin/sh: 1: Syntax error: "(" unexpected
make: *** [build/redis.luvit] Error 2

seems like CFLAGS contains wrong value

$(CC) ${CFLAGS} -I${HIREDISDIR} -Isrc -o $@ $^ ${LIBS} ${HIREDISDIR}/libhiredis.a

LUVIT = luvit
CFLAGS  = $(shell $(LUVIT) --cflags | sed s/-Werror//)

Fatal error on make build

cc -I/usr/local/Cellar/luvit/0.8.2/include/luvit -I/usr/local/Cellar/luvit/0.8.2/include/luvit/uv -I/usr/local/Cellar/luvit/0.8.2/include/luvit/luajit -I/usr/local/Cellar/luvit/0.8.2/include/luvit/http_parser -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -Wall  -fPIC -Ideps/hiredis -Isrc -o build/redis.luvit src/redis.c deps/hiredis/libhiredis.a -shared -lm -undefined dynamic_lookup deps/hiredis/libhiredis.a
In file included from src/redis.c:28:
/usr/local/Cellar/luvit/0.8.2/include/luvit/utils.h:24:10: fatal error: 'ares.h' file not found
#include "ares.h"
         ^
1 error generated.
make: *** [build/redis.luvit] Error 1

Example.lua script exits and doesn't wait for callbacks

I'm new to luvit so I'm not sure if this is the fault of luvit or of luvit-redis. When I run luvit on example.lua, I don't get any output. I only get output if I set up a server that is listening on a port, by adding the lines below:

-- Load the http library
local HTTP = require("http")

-- Create a simple nodeJS style hello-world server
HTTP.createServer(function (req, res)
  local body = "Hello World\n"
  res:writeHead(200, {
    ["Content-Type"] = "text/plain",
    ["Content-Length"] = #body
  })
  res:finish(body)
end):listen(8080)

I think this may be happening because luvit exits before the redis.print callbacks have a chance to fire.

I'm on OSX 10.8.4 / luvit 0.6.1 (brew) / latest luvit-redis (04f1fe8).

:mget(array_of_key_names, callback) needed

Hi!

I would like to mget potentially large amount of keys, how do I do that? Currently, I hit argc limit (250?).

TIA,
--Vladimir

can't use in my code

When I install complete I can't use it in my code
like this
yangzhu:jcpvp yangzhu$ luvit app.lua 109
/usr/local/lib/luvit/luvit.lua:309: /usr/local/lib/luvit/module.lua:194: Failed to find module 'redis'
no field package.preload['redis']
Cannot find module /usr/local/lib/luvit/redis
Cannot find module /Users/yangzhu/Documents/work/jcpvp/modules/redis
Cannot find module /Users/yangzhu/Documents/work/jcpvp/node_modules/redis
Cannot find module /Users/yangzhu/Documents/work/modules/redis
Cannot find module /Users/yangzhu/Documents/work/node_modules/redis
Cannot find module /Users/yangzhu/Documents/modules/redis
Cannot find module /Users/yangzhu/Documents/node_modules/redis
Cannot find module /Users/yangzhu/modules/redis
Cannot find module /Users/yangzhu/node_modules/redis
Cannot find module /Users/modules/redis
Cannot find module /Users/node_modules/redis
Cannot find module /modules/redis
Cannot find module /node_modules/redis

Build fails looking for ares.h on luvit 0.7.0

git submodule update --init deps/hiredis
Submodule 'deps/hiredis' (git://github.com/redis/hiredis.git) registered for path 'deps/hiredis'
Cloning into 'deps/hiredis'...
remote: Counting objects: 2165, done.
remote: Compressing objects: 100% (958/958), done.
remote: Total 2165 (delta 1288), reused 2012 (delta 1158)
Receiving objects: 100% (2165/2165), 653.51 KiB | 0 bytes/s, done.
Resolving deltas: 100% (1288/1288), done.
Checking connectivity... done.
Submodule path 'deps/hiredis': checked out 'bcf83543762577a9b0f5625c848b7061cc980f30'
make -C deps/hiredis libhiredis.a
make[1]: Entering directory /root/luvit-redis/deps/hiredis' cc -std=c99 -pedantic -c -O3 -fPIC -Wall -W -Wstrict-prototypes -Wwrite-strings -g -ggdb net.c cc -std=c99 -pedantic -c -O3 -fPIC -Wall -W -Wstrict-prototypes -Wwrite-strings -g -ggdb hiredis.c cc -std=c99 -pedantic -c -O3 -fPIC -Wall -W -Wstrict-prototypes -Wwrite-strings -g -ggdb sds.c cc -std=c99 -pedantic -c -O3 -fPIC -Wall -W -Wstrict-prototypes -Wwrite-strings -g -ggdb async.c ar rcs libhiredis.a net.o hiredis.o sds.o async.o make[1]: Leaving directory/root/luvit-redis/deps/hiredis'
mkdir -p build
cc -I/usr/local/include/luvit -I/usr/local/include/luvit/uv -I/usr/local/include/luvit/luajit -I/usr/local/include/luvit/http_parser -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -Wall -fPIC -Ideps/hiredis -Isrc -o build/redis.luvit src/redis.c deps/hiredis/libhiredis.a -shared -lm deps/hiredis/libhiredis.a
In file included from src/redis.c:26:0:
src/luvit-hiredis-adapter.h:15:5: error: unknown type name 'ev_io'
ev_io rev, wev;
^
src/luvit-hiredis-adapter.h:18:33: error: unknown type name 'EV_P_'
static void redisLibevReadEvent(EV_P_ ev_io watcher, int revents) {
^
src/luvit-hiredis-adapter.h:28:34: error: unknown type name 'EV_P'
static void redisLibevWriteEvent(EV_P_ ev_io *watcher, int revents) {
^
src/luvit-hiredis-adapter.h: In function 'redisLibevAddRead':
src/luvit-hiredis-adapter.h:44:9: warning: implicit declaration of function 'ev_io_start' [-Wimplicit-function-declaration]
ev_io_start(EV_A_ &e->rev);
^
src/luvit-hiredis-adapter.h:44:21: error: 'EV_A_' undeclared (first use in this function)
ev_io_start(EV_A_ &e->rev);
^
src/luvit-hiredis-adapter.h:44:21: note: each undeclared identifier is reported only once for each function it appears in
src/luvit-hiredis-adapter.h: In function 'redisLibevDelRead':
src/luvit-hiredis-adapter.h:54:9: warning: implicit declaration of function 'ev_io_stop' [-Wimplicit-function-declaration]
ev_io_stop(EV_A_ &e->rev);
^
src/luvit-hiredis-adapter.h:54:20: error: 'EV_A_' undeclared (first use in this function)
ev_io_stop(EV_A_ &e->rev);
^
src/luvit-hiredis-adapter.h: In function 'redisLibevAddWrite':
src/luvit-hiredis-adapter.h:64:21: error: 'EV_A_' undeclared (first use in this function)
ev_io_start(EV_A_ &e->wev);
^
src/luvit-hiredis-adapter.h: In function 'redisLibevDelWrite':
src/luvit-hiredis-adapter.h:74:20: error: 'EV_A_' undeclared (first use in this function)
ev_io_stop(EV_A_ &e->wev);
^
src/luvit-hiredis-adapter.h: At top level:
src/luvit-hiredis-adapter.h:85:29: error: unknown type name 'EV_P_'
static int redisLibevAttach(EV_P_ redisAsyncContext *ac) {
^
src/redis.c: In function 'lua_create_client':
src/redis.c:359:3: warning: implicit declaration of function 'redisLibevAttach' [-Wimplicit-function-declaration]
redisLibevAttach(EV_DEFAULT_ redis_async_context);
^
src/redis.c:359:20: error: 'EV_DEFAULT_' undeclared (first use in this function)
redisLibevAttach(EV_DEFAULT_ redis_async_context);
^
src/redis.c:359:32: error: expected ')' before 'redis_async_context'
redisLibevAttach(EV_DEFAULT_ redis_async_context);
^
In file included from src/redis.c:26:0:
src/redis.c: At top level:
src/luvit-hiredis-adapter.h:38:13: warning: 'redisLibevAddRead' defined but not used [-Wunused-function]
static void redisLibevAddRead(void *privdata) {
^
src/luvit-hiredis-adapter.h:58:13: warning: 'redisLibevAddWrite' defined but not used [-Wunused-function]
static void redisLibevAddWrite(void *privdata) {
^
src/luvit-hiredis-adapter.h:78:13: warning: 'redisLibevCleanup' defined but not used [-Wunused-function]
static void redisLibevCleanup(void *privdata) {
^
make: *_* [build/redis.luvit] Error 1

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

tadeuszwojcik / luvit-redis Goto Github PK

luvit-redis's Introduction

luvit-redis - fast luvit redis client.

Installation

from git

Usage

Benchmarks

Comparison of node-redis and luvit-redis.

Summary: luvit-redis is about 3x to 13x faster than node-redis.

luvit-redis (benchmark.lua)

node-redis (multi_bench.js)

Sending Commands

API

Connection events

"connect"

"disconnect"

"error"

redis:new(port, host, autoReconnect)

autoReconnect

client:registerCommand(...)

client:command(...)

client:disconnect()

redis.print()

TODO

Contributors

Credits

License

luvit-redis's People

Contributors

Stargazers

Watchers

Forkers

luvit-redis's Issues

Recommend Projects

Recommend Topics

Recommend Org

Comparison of `node-redis` and `luvit-redis`.

Summary: `luvit-redis` is about 3x to 13x faster than `node-redis`.

`luvit-redis` (benchmark.lua)

`node-redis` (multi_bench.js)