redis + ruby + monit
Pull classifieds from external sources and synchronize them to a local web service.
A classified hub solution: post a classified, one time from anywhere and it will be published on multiple partners sites.
- Pull classifieds from external SI.
- Store individually in redis with sha1 hash
- Use hashes for crud operation comparaison
- Update super fast with multiple workers poping from redis and pushing on REST services
- ruby workers kept alive and monitored with monit