Skip to content

Latest commit

 

History

History
38 lines (26 loc) · 824 Bytes

TODO.md

File metadata and controls

38 lines (26 loc) · 824 Bytes
Raw

TODO

Idea

  1. Implement generation of models and products
  2. Write short post.
  3. Confirm with Benoit.
  4. Provide code talk.
  5. Write blog post.

Plan

  1. Introduce ProductCreator.

  2. Finalize product creation with API

  3. Check if a php worker is as fast as a shell script. If so, get rid of shell variant.

  4. Monitoring.

  5. Find better lib for AMQP/rabbit.

    1. http://php.net/manual/fa/book.amqp.php (enable amqp in docker)
    2. https://github.com/php-enqueue/enqueue-dev

  6. Learn supervisord.

  7. Try to compare with CSV import.

Upserter

  1. log all unrecoverable messages // identifier|code, status_code, message, errors

Timing

Without batch/upserts 20.10.2018: 1000 products - 11 min

Batch/upsert (1 model consumer / 3 product consumers) 22.10.2018: 1000 models / 5000 products - 6 min