I think its an awesome idea, really. I had an almost identical idea after wading through interviewing potential candidates where I work. 90% of people recruiters send to you are barely screened, unprepared and underqualified. It seemed to me that if a recruiter would just sit people down for a few weeks and teach some relavent job skills, they'd have a much higher success rate.
I don't think you'll have a big problem meeting that goal. I just hope you guys can move to other markets (I assume you're only in SF right now?). There's a severe shortage of Rails devs in other places, because the best ones tend to migrate.