This is EXACTLY why I won't do software development. And I have a CS degree, but I just hate this shit so much. They want people that can churn out code as fast as they can and nothing else. Usually this means using a very high level UI or coding language that dumbs everything down. I just don't see the appeal, especially given the ridiculous hours spent in front of a computer screen writing code and debugging it to begin with, not even to mention trying to debug something you copy/pasted or don't fully understand. Lame.
Actually, the dumbing Down you speak of is an advance, not a regression. The purpose of the engineering field is to create useful things, not to have a playground for the satisfaction of esoteric interests.
That should be done as a side hobby if one desires.
In order to maximise our ability to build complex architectures, it is necessary to minimise complication as much as possible. That means abstracting away low level detail. The greater the abstraction we can achieve, the greater the scale we can achieve.
This abstraction is happening at breakneck speed all around us in all sorts of fields, and the eye it all turns around is of course the tech field.
This new reality is something that should actually be a source of pleasure for INTPs. The world is coming towards us. We're better equipped to flourish in this new reality than past ones.
We're architects by disposition, not mechanics or artisans, hence our fulfilment is in the creation of great complex but simple systems that follow logical laws. It is not in the creation or maintenance of arcane and ugly monstrosities that can't be easily understood, extended or adapted.
What frustrates me about much in the current tech world seems actually the opposite of what troubles you. I get the feeling that much of it has bashed together by ISTPs rather than by INTPs.
An ISTP primarily wants cool toys to play with, and the products he creates are typically high on complication, since the immediate effect achievable is the focus. Scalability and sustainability don't figure as highly.
In terms of the organisational straightjacket, that is the result of organisations being the product of TJs.
It is actually a good thing that this is the case. Of course its excesses manifest themselves often. But the excess of the Te tyranny is exaggerated by us, since it runs contrary to our nature. A healthy dose of Te is actually necessary to prevent the world around us from descending into chaos.
All the cognitive dispositions have a vital role to play in the human condition. The trick is to try to carve a path for oneself that treads the terrain of comfort (one's valued functions) as much as is possible, while acknowledging the beauty of and allowing the landscape around us (the unvalued functions) to add to our enjoyment of life.
SDx should empower INTPs immensely.