That's why I typically prefer to build my base application on a standalone processor and export Bluetooth or Wifi duties to an nRF52820 or ATWILC1000.
Yes, the processor required to run these network protocols is pretty beefy, so a big and fast chip like those made by Espressif has plenty of capacity to run your own app alongside the big communication stacks, but it's far simpler and more power efficient to let a small and simple Bluetooth chip do only Bluetooth stuff, and power it up or down as needed and talk to it over SPI or whatever from a host processor that you have full control of.
Yes, the processor required to run these network protocols is pretty beefy, so a big and fast chip like those made by Espressif has plenty of capacity to run your own app alongside the big communication stacks, but it's far simpler and more power efficient to let a small and simple Bluetooth chip do only Bluetooth stuff, and power it up or down as needed and talk to it over SPI or whatever from a host processor that you have full control of.