There is a very cool youtube video with something similar from Stuff Made Here:

https://www.youtube.com/watch?v=cQO2XTP7QDw

Was very fun to watch and he also explains the trials and errors, he did.

There is also a link to a very interesting repository of handwriting synthesis: https://github.com/sjvasquez/handwriting-synthesis