Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm impressed with the accuracy of MobileWorks over mechanical Turk (or pure MT- not sure if MW just filters workers heavily). I tried a receipt transcription task where I fed the same instructions and same photo to both services. Out of the box, MW was 100% while MT was about 90% for the same cost.


As Anand said we have a separate workforce. We have a bunch of algorithmic and social elements that we have developed for improving quality. In fact,we have written an IEEE paper on how to improve quality in crowdsourcing.

http://www.cs.berkeley.edu/~bjoern/papers/kulkarni-mobilewor...


Glad to hear it! This is an important philosophical difference for us. Quality control in a cloud labor service should be the platform's job, not the customer's. The system should work correctly out of the box.

And yes, our workforce is separate from Turk's - part of the reason the quality is better.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: