That's why I like the idea (if not necessarily the implementation) of things like zepto.js. Keep the jQuery syntax. Use the tiny, optimised library when you can. Use jQuery when you can't.
Except you have no reliable to way to know when you can and when you can't (and no good way to swap between libraries). Best you can do is conditional comments to target old IE versions and you sure don't want jQuery on that team.