+1, I have a c4ai docker container + brave search MCP (2000 queries/mo free!) running on my laptop so I can ask claude code to do research similar to GPT deep research, but I config to ignore robots.txt since it's a one-off instance collecting data on my personal behalf, not a service (At least that's how I justify it)
