The money that gets borrowed from the Fed is used to settle balances between banks. When a bank originates a loan, they just add a number to an account. The money doesn't come from anywhere. This works mainly because most money transfers are electronic.

tl;dr yes, banks create money out of thin air. It's been this way for decades.