Re: Eliminate filesort in update query

[Matzz -]

I have to use queue. Before starting workers I have list of 800k tasks. Workers could produce new ones. What is more, tasks has priorities. Tasks persistence is also very important think in my application. I could not lost task which was not executed when worker died.
I could some message brokers like Kafka or Rabbit but as far as I know they do not provide priorities. Another options is some Actor based parallelism (eg. Akka) but task management would be difficult. Mysql gives me possibility to delete, update or suspend tasks. I could retrieve failed one and see statistics.
Executing my task require http request, so mysql is not the bottleneck now (it was when poll query took 30s, now it is less than 1).

PS
My fork of bramp/db-patterns - github.com/Matzz/db-patterns/ (including mysql queue with priorrities, statuses etc)