The main problem with in memory databases is that they are not the same database. I've had several issues which I had to find a fix that worked on one database and was legal syntax on the other. Say maybe one database allows force index but in memory does not.

I've even seen one database layer for in memory and a completely different one for real database. That means that your unit tests are not really testing your production code