Async vips_call() about php-vips-ext HOT 11 CLOSED

Hello, that's an interesting idea. It's certainly threaded, so it should work. The node.js libvips binding is async.

You'd need to write a little wrapper to do async dispatch I suppose, but I've never looked into it. You'd need to ask a PHP expert.

from php-vips-ext.

Working example using thread pool from libuv.

Required: PHP 7 ZTS, and php-uv module.
pecl install uv
http://pecl.php.net/package/uv

<?php

$loop  = uv_default_loop();

$thread = function()
{
	echo "THREAD-CALL\n";

	$opt =
	[
		'height'      => 1920,
		'size'        => 2,
		'auto_rotate' => 1,
		'crop'        => 0,
		'linear'      => 0
	];

	$img = vips_call('thumbnail', null, '/opt/exif.jpg', 1920, $opt)['out']?? null;

	if($img === null)
	{
		echo vips_error_buffer()."\n";
	}
	else
	{
		vips_image_write_to_file($img, '/var/www/thumbnail.jpg');
	}
};

$after = function()
{
	echo "THREAD-CALL-AFTER\n";
};

for($i = 0; $i < 4; $i++)
{
	uv_queue_work($loop, $thread, $after);
}

uv_run($loop);

vips_call() - Running in a separate thread, is overheads, async callback be rationally.

from php-vips-ext.

Woah, nice job!

from php-vips-ext.

PHP ZTS thread pool from libuv, often segmentation crash :(

We used GraphicsMagick, as worker, send to STDIN
http://www.graphicsmagick.org/batch.html

Run (spawn child process)
gm batch -

Write to STDIN
convert big.jpg -format "%w %h %[exif:DateTime]" -write info:- -strip -resize "250x250>" small.jpg\n

Read from STDOUT
800 600 2015-06-12\n

It is safely and works quickly, one worker process gm, executing requests the pipeline mode from STDIN, in vips_tools such prog there is? :)

Thank.

from php-vips-ext.

Yes, vips has vipsthumbnail, a command-line resizer. It's file operations only though, so you'd need to go via the filesystem.

We should be able to get the libuv one working though, I wonder what the issue is. I'll see if I can reproduce it here.

from php-vips-ext.

I looked at vips lua, I can write lua script, use as child PHP process

$work = Worker::spawn('luajit my_script.lua');
$work->write('...'); // write to STDIN script.lua

from php-vips-ext.

I'm working on vips-lua at the moment, it's not finished yet. Another week or two.

You could write a php script and call that as a child process, that would be a simple solution.

libvips is used with libuv in node.js with very large deployments (tumblr, etc.) and it works fine, so I think the crashes you are seeing must just be problems with php-vips-ext. I suppose we must add some locks to this file:

https://github.com/jcupitt/php-vips-ext/blob/master/vips.c

Do you know what the rules are for what calls need locks? Is there a document I can read?

from php-vips-ext.

Do you know lua well? If you do, some help on lua-vips would be very welcome. I'm not a lua expert at all, and it would be wonderful if someone who knew what they were doing could check it for dumbness.

from php-vips-ext.

Do you know what the rules are for what calls need locks? Is there a document I can read?

I'm not an expert in multithreading, my experiments showed that PHP ZTS and libuv without Vips, segmentation errors, so I abandoned this idea.

Crashing main PHP process is not allowed, our main PHP process is engaged in important business logic.

Do you know lua well? If you do, some help on lua-vips would be very welcome. I'm not a lua expert at all, and it would be wonderful if someone who knew what they were doing could check it for dumbness.

I wrote my first script on lua yesterday, i learning :)

from php-vips-ext.

I resolve the cause, this problem in php-ext-raphf is thread not safe, without it everything works well.

from php-vips-ext.

Good news! I'll close.

from php-vips-ext.