Do the db guys at your company help you optimize queries and table set up at all? Ours basically don’t at all. Their job is to maintain the db apparently and us devs are left to handle this and it seems wrong. I’ve been partitioning tables and creating indexes the past few weeks trying to speed up a view and running explain analyze and throwing the results in Gemini and my queries are still slow af. I had one sql class in college, it’s not my thing. Seems like if dbas would spend a few minutes with me asking about the data and what we are trying to do they could get this guys results relatively easily. Am I wrong?
We didn’t use the DBA’s for this but my last few teams, we got good at DB’s, performance etc. DBA’s were too general and they kept the lights on, but for real performance you should get one or two people who know what they’re doing for your applications. Or learn. I took on juniors who are now fantastic.
For the first decade I wanted nothing to do with DB’s aside from places to store data. One day I saw a few things that made a massive difference and then went wild on learning how to speed things up. It’s fantastic and because few devs know this stuff well, it becomes a superpower. You wouldn’t believe what you can squeeze out of modern SQL DB’s and hardware, without touching any kind of optimised solutions. Which I love too but that’s a different post.
Maybe ask the DBA’s a few questions and see if that triggers any interest for you. Look at query plans and how many rows are processed for a query. How many columns. What is being locked. Can you remove locks when you’re just running a query and how much does that speed things up. There are queries for all sorts of metrics, eg which indexes are huge but never used. The DB can often suggest indexes, but don’t just use add the suggestions. Use them as a starting point to reason about your own. Try get down to low millisecond queries for really frequent stuff, because it’ll make them fast and means less time locking the DB, less RAM, less temp table storage.
All my other skills have aged. Fundamental database knowledge lasts.
1) dba - maintain OS, db software/hardware - DBs are complex beasts you want experts setting up hardware or deploying into the clown in a smarter way (virtual machines in the clown will cost you a fortune and your sanity)
2) database developers- specialists in writing sql.
The two functions work together but are distinct.
Nowadays due to private equity and Stanford MBAs we have junior engineers doing all plus “dev ops”.
It’s an absolute circus.
IMO, this is why we end up with ask these crazy DB startups - routing around the damage.
RDMS in modern hardware are insanely fast and powerful.
I always see these fancy DB engines and data lake blog posts and I am curious… why?
At every place I’ve worked at this is a solved problem: Hive+Spark, just keep everything sharded across a ton of machines.
It’s cheaper to pay for a Hive cluster that does dumb queries than paying these expensive DB licenses, data engineers building arbitrary indices, etc… just throw compute at the problem, who cares. 1TB of RAM /flash is so cheap these days.
Even working on the worlds “biggest platforms” a daily partition of user data is like 2TB.
You’re telling me a F500 can’t buy a 5 machine/40TB cluster for like $40k and basically be set?
Just dump it in Hadoop became an anti-pattern and everyone yearned for databases and clean data and not dealing with internal IT and the cluster “admins”.
I’m not sure you are seeing it clearly..or have any trading experience whatsoever. They took substantial risk. There is always someone bigger so if they were wrong they could have been buried. Then they reversed. If there are allegations of insider trading or collusion or something else then I’m ready to pile on but I don’t see anything here.
“Manipulation” is what? You want to create a rule that says a firm can’t buy more than x shares/dollars/% in a certain amount of time? Or if it does it has to hold onto those shares for a minimum time? A firm should be able to buy as much as it wants, subject to its margin requirements, and then sell whenever it wants, be it one second, one minute, one hour, one day…later.
I disagree. I don't think transacting for transacting sake is a good thing. If anything I just see it as a vehicle for both obfuscation, and a means with which to arbitrage info asymmetry against retail investors.
And no, I don't think merely adding liquidity is worth that being practicable and nigh-impossible to unwind.
Grid-tied inverters only push power if it senses the grid. It’s a standard feature and has been around for years. Off grid inverters push no matter what. The situation you fear is somebody not knowing what kind they have and just plugging it in.
Can you share your before and after bills? How long til you break even? What happens if you push 800w but your home is only using 300w? Without a clamp on main panel I don’t think it’s smart enough to know to push only 300 so does 500 go to the grid?
I’m confused what ecoflow says. The Utah law says it must be a UL certified device. Ecoflow says something about not needing to wait for UL standard. Are they talking about the same thing? Or is ecoflow saying don’t need to wait for a UL standard for a receptacle but their micro inverter is UL certified?
There was an article in the LATimes article a few years ago with the former ceo of Ticketmaster who explicitly confirmed the above. Ticketmaster does a deal with the band to charge as much as possible and take all the negative blowback or whatever about it and then gives them a kickback.
I nearly drowned in my early 30s surfing in conditions that were the biggest I had ever experienced (double to triple overhead). On the skills vs risk chart the author mentions I was low-mid skilled in a higher risk environment. I grabbed the first wave of a large set that rolled through and ended up wiping out. Somehow in the washing machine my leash lasso’d around my legs making them virtually worthless in my struggle. Imagine swimming without legs…it doesn’t work at all. The set waves behind mine were crashing over me and keeping me under. This particular storm was angled perfectly for my break and was very strong at a relatively close distance meaning set waves came in groups of up to 10 as opposed to the normal 2-3. I don’t know how long I was under. My struggle was intense. I feel like the entire time I was thinking clearly but only bc I didn’t have time to panic, maybe? Like the author I thought about my family. I remember being close to the surface once and then getting pounded again. Then an extreme calm came over my body. My vision went black and I remember thinking “this is it, it’s time”. Next thing I remember I surfaced… maybe it was right after I thought it was over, maybe I passed out for some time? Like the author I pretended to just shake it off like no big deal. I told the story like a badge of pride, showing fearlessness and strength or whatever. Never once did I say I was stupid for being out there in the first place. But I was almost that idiot that died after saying “hey y’all watch this”. I do hope my eventual death feels like the calm that came over me here though. I’ll never forget how peaceful that felt…
For real. I’m trying to diy a battery now with 304ah lifepo4 cells and it works out to 125wh/kg. Doesn’t seem like even 300wh/kg will trickle down to the public anytime soon.
High energy density isn't the only desirable goal of course. Really cheap, bulk storage, hard to damage, with long lifetime and many recharge cycle batteries are good for grids even if they're too heavy for the mobile | car market.
I’m sorry for that painful price drop you experienced but that is on you for paying 70k, a price that literally and explicitly was jacked up for the purpose of decreasing demand in order to resolve the order backlog at the time. Don’t forget all other car makers were doing the exact same thing at the time so this isn’t a Tesla specific issue though Tesla was probably the most extreme.
Walnuts are where it’s at (but agreed pine nuts are clearly the winner). Homemade pesto with homegrown basil was a revelation in our house. Better than any store bought and a fraction of the price.
