btw I'm probably going to implement something new around the orchestrator:
Righ now when a job appears, the orchestrator picks the fastest available worker. There currently isn't enough demand so that 2 workers are needed at the same time. This causes the orchestrator to always pick the same worker and other workers to never earn something.
I'm going to change it to this: Instead of picking the fastest worker, it will pick a worker at random with weighted chances of how many tok/s that worker is running. This means all workers have a chance at making money, weighted by their performance.
This should make more people more money, instead of one person all the money.