I've had the opposite experience so far. Eclipse IDE that uses 1GB+ of RAM? Compiles java code to bytecode instantly everytime you save.
Sublime Text + gcc for a C++ project? Well, you have to live with the fact that sometimes a rebuild is going to take more than 5 minutes.
In other words it has nothing to do with how bloated the dev environment is and more with the fact that some programming languages have features that can cause excessive build time.