This is why I refuse to work in production code bases in python, it’s a nightmare of build systems, linters, package managers (dear god help the poor soul who accidentally pip’d from pypi and not your companies artifactory instance), formatters, convoluted ci pipelines that always seem to fail, a series of “senior” devs that will make you redo everything because you wrote your own map (we don’t use functional programming here meme) instead of a for loop (can’t use list comprehension for “code readability issues”). Got to the point of just saying fuck it, I’ll write it in Scala or rust, SBT and Cargo god tier.

I used to have to use a CI pipeline at work that had over 40 jobs and 8 stages for checking some sql syntax and formatting and also a custom python ETL library that utilized pandas and constantly got OOM errors.

They didn’t write any unit tests because “we can just do that in the CI pipeline” and if you didn’t constantly pull breaking changes into your branch you would guarantee the pipeline would fail, but if you were lucky you only had to restart 30% of your jobs.

It was the most awful thing and killed developer productivity to the point people were leaving the team because it sucks to spend 40% of your time waiting for CI scripts to fail while you are being yelled at to deliver faster.

Because your dipshit Director, who came from a consulting firm like BCG or McKenzie and who couldn’t manage to throw together a “Hello, world” script in python now believes he is an expert in all tech because he read a medium article by a boot camp grad of some 8 week React course and thinks that giving Palantir Foundry $3 million a year to do basic ETL that was done previously by a couple junior devs is somehow “safer” than “writing custom code”, and by “custom code” I mean utilizing Apache Spark, Polars, and other open source tooling that Palantir Foundry is also utilizing, but charging you 40,000% more to use.