Add queue interop based driver. Supports AMQP, Amazon SQS, Kafka, Google PubSub, Redis, STOMP, Gearman, Beanstalk

[makasim]

The interop driver uses queue-interop compatible transports (as of now we have 10th of them). There are many implementations in enqueue project.

Advantages

• Supports message delaying, priorities and expiration

• Use DSN to configure transport. 12 factors friendly.

• It brings support of a lot of MQ transport with few lines of integration code:

  • AMQP(s) based on PHP AMQP extension.
  • AMQP based on bunny.
  • AMQP(s) based on php-amqplib.
  • Beanstalk.
  • STOMP
  • Amazon SQS
  • Google PubSub
  • Kafka
  • Redis
  • Gearman
  • Doctrine DBAL
  • Filesystem
  • MongoDB
  • WAMP
  • PHP-FPM
  • rabbitmq-cli-consumer-client

• Consume messages as they arrive from multiple queues.

• You can run fewer work processes and reduce memory usages.

• It uses long pulling whenever possible. It results in zero CPU usages while waiting for messages.

• You can monitor any transport, not only redis

• Adds extension points

• AMQP friendly.

• Popular soliution, big and active community around the project

• Supported by a company - Forma-Pro

Example

• Install the real transport for example enqueue/fs

composer require enqueue/fs

• configure

<?php

// config/queue.php

return [
    // ....

    'connections' => [
        'interop' => [
            'driver' => 'interop',
            'dsn' => 'file://realpath(__DIR__.'/../storage').'/enqueue',
            // 'dsn' => 'amqp://guest:guest@localhost:5672/%2f'
            // 'dsn' => 'redis:'
        ],
        // ...
    ],
];

Use it as any other native driver. I welcome everyone who is interested in MQs to join the queue interop group

[taylorotwell]

Going to hold off on this for now.

[deleugpn]

@makasim have you thought about proposing a PSR for that instead?

[makasim]

@deleugpn Indeed! Here's the topic on their ML: https://groups.google.com/d/msg/php-fig/CcFN7zr90Wo/3ihpslRDBwAJ

[makasim]

@taylorotwell could you please provide us with a bit more info? I would really appreciate that

[makasim]

Released as a standalone lib: https://github.com/php-enqueue/laravel-queue

[makasim]

The package has matured and gained some popularity. Supports many transports which could be configured in one line (see an example above).

@taylorotwell would you reconsider your choice? What could I do to make it happen?

[deleugpn]

Taylor usually don't revisit closed PRs. You may just open a new PR and try again. Be prepared to answer questions like "What is the benefit this brings to Laravel users?" or "Would you be able to tell how many downloads are coming from Laravel projects?" and "Why is it better than our current queuing system?".

[mfn]

Before working on PR and investing resources/time it should be brought up on https://github.com/laravel/ideas

[makasim]

The most popular Laravel AMQP package is based on queue interop, hope its downloads could be counted in.

[priyashpatil]

@taylorotwell I think would be an awesome addition. This opens the door to true microservice with Laravel.

[GrahamCampbell]

The door is not shut. This can easily be provided as a third party package as a driver.